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I.   INTRODUCTION 

Operations  researchers,  military  planners  and  programmers, 
statisticians,  economists,  marketing  personnel,  managers  and 
others  are  often  faced  with  the  need  to  analyze  data  in  the 
form  of  a  time  series,  which  can  be  thought  of  as  a  sequence 
of  observations  of  either  a  deterministic  or  stochastic 
process.   In  most  cases,  the  objective  of  the  analysis  is 
to  determine  patterns  or  other  recognizable  behavior  appar- 
ent in  the  data,  and  to  then  formulate  a  suitable  mathemati- 
cal model  for  the  time  series  from  which  forecasts  of  future 
behavior  can  be  obtained.   The  value  to  a  decision  maker 
of  being  able  to  predict  the  future  with  some  reasonable 
and  statistically  quantifiable  degree  of  accuracy  can  not 
be  overstated.   For  example,  in  areas  such  as  budget  expen- 
ditures, recruiting  performance,  commodity  prices,  population 
levels,  resource  consumption,  manpower  levels  and  consumer 
demand  for  products,  decision  makers  charged  with  planning 
for  the  future  should  base  their  decisions  at  least  in 
part  on  the  best  available  predictions  about  the  future 
behavior  of  the  time  series  in  question. 

Until  the  late  1960 's,  the  techniques  employed  in  time 
series  analysis  were  primarily  those  of  spectral  analysis, 
with  applications  of  harmonic  analysis  and  mathematical 
transform  theory.   For  an  introduction  to  these  topics,  the 
reader  is  referred  to  Anderson  [Ref.  2],  Lewis  [Ref.  7] 
and  Jenkins  [Ref.  10].   Due  to  the  high  degree  of  mathematical 


sophistication  required  by  the  spectral  analysis  approach, 
the  capability  to  perform  time  series  analysis  resided  nearly 
exclusively  with  mathematicians  and  electrical  engineers. 
As  a  consequence,  the  majority  of  decision  makers  came  to 
use  more  understandable  (and  far  less  powerful)  methods 
such  as  simple  moving  averages  or  exponential  smoothing. 
However,  in  the  late  1960's  and  early  1970 's,  the  statistical 
analysis  of  time  series  by  the  methods  developed  by  Box 
and  Jenkins  [Ref.  4]  has  gained  widespread  acceptance. 
Although  these  methods  are  mathematically  nearly  equivalent 
to  the  spectral  approach  (there  are  transformations  that 
interconnect  the  two  methodologies) ,  the  Box- Jenkins  approach 
is  described  in  vocabulary  more  familiar  to  operations 
researchers,  statisticians,  economists  and  managers,  and 
is  therefore  being  used  more  and  more  by  them  in  building 
models  from  measurements  of  the  past. 

Many  algorithms  and  computer  programs  for  performing 
the  analyses  required  by  the  Box-Jenkins  approach  have  been 
developed  and  are  available  from  several  sources.   Perhaps 
the  best  source  is  the  collection  of  FORTRAN  computer  sub- 
routines which  resides  in  the  International  Mathematical 
and  Statistical  Library  (IMSL)  [Ref.  9].   The  primary  prob- 
lem with  using  the  available  computer  resources  lies  not 
in  any  deficiency  of  the  programs  themselves,  but  with  the 
very  nature  of  the  Box- Jenkins  methodology  itself.   The 
Box-Jenkins  method  is  an  iterative  approach  to  time  series 
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analysis,  which  is  briefly  described  in  Figure  1.   [See 
Wheelwright  and  Makridakis,  Ref .  16.] 

As  indicated  by  Figure  1,  the  Box- Jenkins  method  is  a 
multi-stage,  iterative  process.   It  begins  with  the  postu- 
lation  of  a  general  class  of  time  series  models  which  has 
been  found,  experimentally,  to  be  extremely  rich.   There- 
after, the  procedure  continues  as  a  trial-and-error  process, 
with  decisions  points  where  the  analyst  is  required  to 
select  the  next  direction  based  on  the  best  information 
available  to  him.   Since  each  stage  of  the  process  outlined 
in  Figure  1  may  consist  of  several  sub-steps,  the  modeling 
process  itself  can  become  quite  time-consuming,  even  with 
the  ready  availability  of  the  IMSL  software  resources.   For 
example,  an  analyst  employing  the  IMSL  subroutines  in  a 
batch  processing  computer  system  to  perform  Box-Jenkins 
modeling  of  a  time  series  might  perform  the  following 
sequence  of  tasks: 

1.  Prepare  the  time  series  data  in  the  proper  format. 

2.  Plot  and  visually  examine  the  time  series,  checking 
for  nonstationarity ,  trends,  seasonality,  patterns, 
etc . 

3.  Write  a  program  to  call  the  IMSL  subroutine  that 
will  calcuate  the  mean,  variance,  autocorrelations 
and  partial  autocorrelations  of  the  series. 

4.  Plot  the  autocorrelations  and  partial  autocorrela- 
tions; this  provides  much  of  the  information  re- 
quired for  identifying  the  correct  model  for  the 
series. 
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FORECASTING  AND 
CONTROL 


FIGURE    1.       The   Box- Jenkins    Forecasting   Methodology 
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5.  Write  a  program  to  call  the  IMSL  subroutine  which 
transforms  the  time  series  to  adjust  for  seasonal 
patterns,  nonstationary  behavior  or  other  behavior 
which  deviates  from  that  assumed  for  the  class  of 
models  postulated. 

6.  Repeat  steps  (2)  through  (4)  with  the  transformed 
data. 

7.  Review  the  statistical  properties  of  the  auto- 
correlations and  partial  autocorrelations  for 
tentative  model  identification. 

8.  Write  a  program  to  call  the  IMSL  program  that 
estimates  the  model  parameters  and  computes  the 
residuals. 

9.  Write  a  program  to  perform  goodness-of-f it  tests 
for  the  model. 

10.  Analyze  the  model  residuals,  using  steps  (1)  through 

(9),  as  with  the  original  time  series. 

11.  Refine  the  model  using  information  gained  by 
examination  for  any  structure  in  the  residuals. 

12.  Repeat  the  preceding  process  until  no  structure 
remains  in  the  residuals. 

13.  When  an  adequate  model  has  been  obtained,  write  a 
program  to  call  the  IMSL  subroutine  which  forecasts 
and  determines  confidence  intervals  for  future 
values  of  the  time  series. 

Between  each  successive  pair  of  steps,  the  analyst  must 
manually  intervene  in  the  analysis  process,  making  a  decision 
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subjectively  based  on  the  information  then  available. 
Thus,  much  analyst  interaction  is  necessary  in  order  to 
determine  a  suitable  mathematical  model  and  forecast  equa- 
tion.  Even  with  rapid  computer  job  turnaround  time,  the 
process  described  above  could  easily  consume  a  full  working 
day  or  more. 

This  paper  describes  an  effort  to  alleviate  some  of  the 
organizational  problems  inherent  in  the  modeling  of  time 
series  using  the  Box-Jenkins  iterative  approach.   This 
effort  consists  of  an  interactive  computer  program  package 
which  provides  access  in  a  structured  way  to  the  most  useful 
IMSL  and  other  subroutines  necessary  for  Box-Jenkins  time 
series  analysis.   This  package,  called  the  Time  Series  Editor, 
is  written  for  use  with  the  Naval  Postgraduate  School's 
Control  Progam/Cambridge  Monitor  System  (CP/CMS) .   Since  all 
working  programs  with  the  exception  of  the  executive  routine 
itself  are  written  in  FORTRAN,  the  Time  Series  Editor  should 
be  adaptable  for  use  on  other  FORTRAN-capable  time-sharing 
systems.   The  Time  Series  Editor  assists  the  analyst  in 
data  preparation  and  entry,  model  construction  and  diag- 
nostic testing,  and  time  series  forecasting.   In  fact, 
with  the  User's  Guide  provided  as  an  Appendix  to  this  report, 
a  complete  Box-Jenkins  time  series  analysis  can  be  per- 
formed in  a  short  time  by  even  a  novice  computer  user. 
For  this  reason,  the  Time  Series  Editor  could  be  a  valuable 
instructional  tool  for  laboratory  use  in  a  time  series 
course. 


14 


A  brief  overivew  of  Box-Jenkins  methodology  is  provided 
in  Chapter  II,  to  serve  as  a  point  of  reference  for  the 
material  which  follows.   Chapter  III  contains  a  description 
of  the  algorithm  employed  to  estimate  non-linear  least- 
squares  parameters  for  a  generalized  (seasonal,  nonseasonal, 
stationary,  or  nonstationary)  Box-Jenkins  model.   Chapter  IV 
contains  descriptions  of  each  of  the  major  programs  in 
the  Time  Series  Editor.   Chapters  V  and  VI  contain  examples 
of  actual  use  of  the  Time  Series  Editor,  using  a  non- 
seasonal  and  a  seasonal  series,  respectively.   Chapter  VII 
includes  a  summary  of  the  report,  and  recommendations  for 
future  additions  to  the  Time  Series  Editor.   The  Appendices 
include  a  User's  Guide  to  the  Time  Series  Editor,  with 
instructions,  sample  user  sessions  and  sample  outputs. 
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II.   BOX- JENKINS  METHODOLOGY:   A  PRIMER 

This  chapter  provides  a  brief  overview  of  the  methodology 
developed  for  the  analysis  of  time  series  data  by  G.E.P. 
Box  and  G.M.  Jenkins,  in  order  to  facilitate  understanding 
of  the  models  and  programs  employed  in  the  Time  Series 
Editor.   For  more  detail  on  the  material  covered  in  this 
chapter,  the  interested  reader  is  referred  to  the  texts  by 
Anderson  [Ref .  1] ,  Box  and  Jenkins  [Ref .  4] ,  Pindyck  and 
Rubinfeld  [Ref.  15],  Nelson  [Ref.  14],  and  Mabert  [Ref.  12]. 

A.   LISTING  OF  NOTATION 

The  following  is  a  listing  of  the  notation  employed 
in  this  chapter  and  in  the  remainder  of  this  report.   Each 
symbol  is  provided  with  a  brief  title  or  explanation  of  its 
use. 


{z  }  a  time  series 

N  the  length  of  the  time  series  (number  of  terms) 

—  ~2 

z,  a  estimates  of  the  mean  and  variance  of  the  time 

series  {z  } 

{z!}  transform  of  {z^},  where  z,_      =    (z^  +  £ ) 

t  t  t      t 

or  z'   =  ln(z   +  c) 

{W  }  differenced  series  from  {z  },  where 

VT  =  V  V  z, 
t      s  t 

p,  autocorrelation  of  lag  k 

rv  estimate  of  autocorrelation  at  lag  k 

V  backward  difference  operator  of  order  d 
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Vc  seasonal  backward  difference  operator  of  order 

D  with  season  s 


s 


5 

B  backward  shift  operator  of  order  s 

s  length  of  the  time  series1  season 

<j>  non-seasonal^autoregressive  parameters 

(estimates,  <£) 

$  seasonal  autoregressive  parameters  (estimates,  $) 

6  non-seasonal^moving  average  parameters 

(estimates,  0) 

0  seasonal  moving  average  parameters  (estimates,  0) 

{a  }  series  of  white  noise  terms  of  the  process 

2 
<j_  variance  of  the  white  noise  process 

a 

S(cj),8)  sum  of  squared  residuals  of  the  model 

p  number  of  non-seasonal  autoregressive  parameters 

P  number  of  seasonal  autoregressive  parameters 

q  number  of  non-seasonal  moving  average  parameters 

Q  number  of  seasonal  moving  average  parameters 

ip(B)  transfer  function  of  a  linear  filter 

<j>,,  partial  autocorrelation  of  lag  k 

B.   TIME  SERIES,  STOCHASTIC  MODELS  AND  STATIONARITY 

A  distinguishing  feature  of  modern  time  series  analysis 
is  that  the  sequence  of  observations  of  a  given  variable  is 
considered  to  be  a  realization  of  jointly  distributed 
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random  variables,  such  that  the  time  series  itself  can  be 
viewed  as  a  stochastic  process.   A  discrete  stochastic 
time  series,  then,  is  a  set  of  observations  (z_,z  ,...,z  ) 
generated  sequentially  in  time  by  a  set  of  jointly  distributed 
random  variables,  where  the  actual  data  (z..  ,  z_  ,  .  .  .  ,  z  ) 
represents  a  particular  realization  of  some  joint  probability 
distribution  function  f (z, , z_ , . . . , z  ) .   With  this  function 
determined  in  some  way,  a  forecast  z   ,  can  be  thought  of  as 
having  been  generated  by  a  conditional  probability  distri- 
bution f  (z   ,  |  z..  ,  z„,  .  .  .  ,  z  )  .   Now,  the  stochastic  process 
which  generates  the  time  series  (z,  , z„, . . . , z  )  is  said  to 
be  stationary  if  its  properties  are  unaffected  by  a  change 
in  time  origin;  that  is,  the  process  has  reached  a  particular 
state  of  statistical  equilibrium.   This  implies  that  the 
joint  probability  distribution  associated  with  the  m 

observations  (z   ,  z   ,...,z   ),  made  at  any  set  of  times 

12       m 

(t, , t~, . .  .  ,  t  ),  is  identical  to  that  distribution  associated 
12      m 

with  the  m  observations  (z    ,  , z    ,,..., z    ,  )  made  at 

12         m 

times  (t,  +k,  t„+k,  .  .  .  ,  t  +k)  . 
1     Z  m 

For  stationary  discrete  time  series,  the  marginal 
probability  distribution  p(z  )  is  the  same  for  all  times 
t.   Hence,  the  stochastic  process  embodied  in  the  time 
series  has  a  constant  mean 


u   =   E[zfc]   =     /  zp(z)dz  , 
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which  defines  the  level  about  which  it  fluctuates  in  time, 
and  a  constant  variance 


a2   =   E[(zt  -  y)2]   =     /  (z  -  u)2p(z)dz  , 


which  measures  its  variability  about  the  level  of  the  mean. 
Since  the  probability  distribution  p(z)  is  the  same  for  all 
times  t,  its  form  can  be  investigated  by  plotting  a  histogram 
or  relative  frequency  plot  of  the  set  of  observations 
(z,  ,  z_  ,  .  .  .  ,  z  )  .   Additionally,  the  mean  and  variance  of 
the  stochastic  process  can  be  estimated  by  the  sample 
averages  taken  over  time: 

N 


1   V 
=   N  I    Zt 


t=l 


and 


N 
2      1 
z      N 

t=l 


I  (zt  -  z) 


C.   THE  BASICS  OF  DIFFERENCE  OPERATORS  AND  LINEAR  FILTER 
MODELS 

This  section  provides  a  brief  discussion  of  the  differ- 
ence operators  currently  employed  in  writing  Box-Jenkins 
models.   Those  most  commonly  used  are  described  below  in 
Table  I. 
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Operator  Name  Definition 


B  Backward  Shift  Operator     Bz   =  z 


of  order  m 


t     t-1 

BSZ+.  =  ^ 
t    t-s 


F  Forward  Shift  Operator      F  =  B 


of  order  m 


Fzt  =  Zt+1 

FX  =  z^ 

t     t+m 

V^  Backward  Difference        V   =  (1  -  B)D 

Operator  of  order  D 

and  season  s  D    ,,    r>s\D 

Vg  -  (1  -  B  ) 

Vzt  =  Zt  "  zt-l 


s 


Table  I.   Basic  difference  operators. 


It  is  noted  here  that  V  z   could  be  written  as  a 


binomial  expansion;  that  is, 


D 

VDz.   =   (1  -  B)Dz,   =   (  I  (D)(l)j(-B)D_j)z. 
t  t       u      3  t 

j=0 

=    z  (?)(-i)D"jZt-D+j  • 

j=0 

The  stochastic  models  employed  in  the  Box-Jenkins  method 
are  based  on  the  idea  that  a  time  series  in  which  successive 
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values  are  highly  dependent  can  be  regarded  as  having  been 
generated  from  a  series  of  independent  "shocks"  a  .  These 
shock  terms,  sometimes  referred  to  as  white  noise  terms, 

are  random  drawings  from  some  fixed  distribution,  generally 

2 
assumed  Normal  with  mean  zero  and  variance  a  .   The  white 

a 

noise  process  a   is  supposed  transformed  to  the  process  z 
by  what  is  known  as  a  linear  filter,  shown  in  Figure  2  below 
[Ref.  4,  p.  8].   The  linear  filtering  operation  takes  a 


White 
Noise 


<MB) 


Linear 
Filter 


Process 


Figure  2.   Representation  of  a  time  series  as 
the  output  from  a  linear  filter. 


weighted  sum  of  previous  observations,  so  that   z   can  be 
written 


zt  =   u  +  at  +  ^  at_1  +  ij,2  at_2  +  ... 


=   y  +  ip(B)  afc  . 


In  general,   y  is  the  parameter  that  determines  the  "level" 
of  the  process,  and 
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iMB)   =   1  +  1KB  +  ip  B2  +  . 

1        A 


is  the  linear  operator  that  transforms  a   into  z  ,  called 

the  transfer  function  of  the  filter.   The  sequence 

ip,/ip2/  •••  formed  by  the  weights  may  be  (theoretically) 

finite  or  infinite;  if  this  sequence  is  finite,  or  infinite 

and  converges,  the  filter  is  said  to  be  stable  and  the 

process  z   stationary.   The  parameter  y  is  then  the  value 
t 

about  which  the  process  varies.  Otherwise,  z  is  called 
nonstationary,  and  y  has  no  specific  meaning  except  as  a 
reference  point  for  the  level  of  the  process. 

D.   HOMOGENEOUS  NON- STATIONARY  AND  SEASONAL  PROCESSES 

In  many  cases  of  interest  to  the  time  series  analyst, 
the  process  being  examined  is  not  stationary.   Instead, 
the  probabilistic  structure  of  the  process  generating  the 
time  series  changes  with  time.   For  example,  there  may  be 
a  trend  or  seasonal  pattern  in  the  time  series.   However,  if 
the  series  can  be  found  to  exhibit  behavior  which  is  somewhat 
homogeneous,  then  the  series  can  frequently  be  transformed 
into  a  stationary  series  that  can  be  described  by  Box-Jenkins 
models . 

A  series  is  said  to  be  homogeneous  nonstationary  of 
order  d  if  w  =  V  z   is  a  stationary  series  for  some  integer 
d.   Here  V  =  (1  -  B)  denotes  the  difference  operator  such 
that  V  a  =  z   -  z   , .   The  fact  that  a  given  series  is 
nonstationary  can  be  determined  quickly  by  examination  of 
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the  autocorrelation  function,  to  be  discussed  later.   The 
series  to  be  modeled  should  be  differenced  until  the  re- 
sulting series  appears  stationary  or  until  the  procedure 
appears  to  be  making  no  improvement. 

A  time  series  is  called  seasonal  when  it  exhibits 
cyclical  behavior  over  time,  showing  a  regular  period. 
Examples  of  seasonal  processes  include  monthly  rainfall, 
monthly  crop  yields,  sale  volume  of  bathing  suits,  livestock 
production  rates  and  energy  consumption.   Seasonal  patterns 
are  often  easy  to  spot  simply  by  observing  a  plot  of  the 
series,  or  through  knowledge  of  the  process  that  generated 
the  series.   However,  in  many  cases  where  the  variability  of 
the  series  is  large,  seasonal  patterns  will  be  difficult  to 
distinguish  from  other  fluctuations.   Recognition  of  season- 
ality in  a  series  is  important,  since  it  provides  information 
useful  in  modeling  and  forecasting;  as  will  be  shown,  the 
autocorrelation  function  can  assist  in  recognizing  seasonality 
The  Box-Jenkins  modeling  approach  for  seasonal  nonstationary 
time  series  of  season  length  s  is  to  first  transform  the 
series  using  an  appropriate  seasonal  differencing  operator 
to  "sweep  out"  the  seasonal  effect;  that  is,  take 


Wt  ■   Vszt 


If  there  is  a  trend  or  other  types  of  non-stationarity  pre- 
sent, as  well  as  the  seasonal  effect,  the  series  can  be 
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differenced  again  with  the  ordinary  difference  operator 
until  stationarity  is  achieved.   This  transform  would  be 
written 


w„  =  vd  vD  z, 

t         st 


The  transformed  series  W   is  then  modeled  as  a  stationary 
series.   For  seasonal  series  where  complete  stationarity 
can  not  be  achieved,  a  class  of  seasonal  models  is  avail- 
able; these  are  discussed  later  in  this  Chapter. 

E.   GENERAL  CLASSES  OF  BOX- JENKINS  MODELS 

This  section  will  provide  brief  descriptions  of  several 
of  the  most  commonly  used  classes  of  Box-Jenkins  models, 
including  autoregressive  (AR)  models,  moving  average  (MA) 
models,  mixed  and  integrated  autoregressive-moving  average 
(ARMA/ARIMA)  models,  and  a  generalized  seasonal  ARIMA  model. 
1.   Autoregressive  Models 

In  autoregressive  (AR)  models,  the  current  value  of 
the  series  under  study  is  expressed  as  a  linear  combination 
of  previous  series  values  that  explain  the  current  obser- 
vation, plus  an  unexplained  random  (white  noise)  term  a  . 
For  a  stationary  series,  or  one  that  has  been  transformed 
to  stationarity,  the  deviation  from  the  mean  value  for  each 
period,  Z   =  z   -  y,  can  be  modeled  as  dependent  on  weighted 
values  of  the  previous  deviations  from  the  mean.   The  AR 
model  can  be  written 
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Zt   =   *lzt-l  +  *2zt-2  +  '••  +  *pzt-p  +  at  ' 


In  the  expressions  which  follow  the  tilde  will  be  dropped, 
but  it  is  to  be  understood  that  the  mean  has  already  been 
subtracted  from  each  observation.   This  equation  is  called 
an  autoregressive  process  of  order  p,  where  <p  .    represents 
a  scalar  weighting  coefficient  for  the  j    previous  period, 
The  model  can  also  be  written  in  more  compact  form  as 


<MB)zfc   =   at  , 


where 


(MB)        =        (1    "    01B    -    <\>2B2    -     ...     -    <j>    BP)  , 


a  polynomial  in  the  operator  B.   Then,  <$>  (B)  represents  a 

general  non-seasonal  AR  operator.   The  reason  these  models 

are  called  autoregressive  can  be  seen  from  recalling 

regression  analysis;  here  the  model  relates  the  dependent 

variable  z   to  a  set  of  explanatory  variables  (z   , ,z    , 

...,z^   ),  which  are  previous  values  of  the  time  series, 
t-p  ^ 

Therefore,  the  model  is  autoregressive.   For  example,  when 
the  value  of  the  time  series  at  time  t  depends  only  on  the 
value  at  time  t-1,  the  model  becomes  an  autoregressive  model 
of  order  1,  denoted  AR(1).   Similarly,  if  the  value  in 
period  t  depends  on  the  values  in  periods  t-1,  t-2  and  t-3, 
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the  model  is  AR(3).   The  following  equations  are  the  mathe- 
matical representation  of  those  two  examples: 


AR(1)  :    zt   =   cD1zt_1  +  at 


AR(3)  :    zt   =   ^2     +  cD2zt_2  +  ^z     +  afc 


2.   Moving  Average  Models 

In  moving  average  (MA)  models,  the  assumption  is  made 
that  the  current  value  of  the  time  series  at  period  t  can 
be  expressed  as  a  linear  combination  of  the  previous  fore- 
cast  errors  (or,  residuals),  a   =  z   -  z   .   The  general 
equation  for  this  model  can  be  written 


z,  —  a,  —  0..a^  ..  —  9_a,  „  —  .  .  .  —  6  a,    , 
t     t     1  t-1     2  t-2  q  t-q 


which  is  called  a  moving  average  model  of  order  q,  where 

'  4- In 

0  represents  the  scalar  weighting  coefficient  for  the  q 
previous  period.  Like  the  AR  model,  the  MA  model  can  be 
written  in  more  compact  operator  notation  as  follows: 


zt  =   6<B)a   , 


where 


9(B)   =   (1  -  6^  -  62B2  -  ...  -  9  Bq)  / 
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a  polynomial  in  the  operator  B.   The  MA  model  implies  that 
the  analyst  can  gain  valuable  information  for  future 
predictions  by  consideration  of  the  weighted  sum  of  a 
number  of  previous  forecast  errors  or  residuals.   The 
following  are  examples  of  MA  models  of  order  1  and  order 
3,  MA(1)  and  MA (3) : 


MA(1)  :   zfc  =  (1  -  61B)at   =   afc  -  Q1at^1    ' 


MA(3)  :   z    =   (l-61B-e2B2-e3B3)at 


~   at  "  6lat-l  "  62at-2  "  63at-3 


3.   Mixed  and  Integrated  Autoregressive-Moving  Average 
Models 

A  natural  extension  of  the  autoregressive  and  moving 

average  models  is  to  construct  a  combination  of  the  two. 

Such  mixed  processes  are  called  autoregressive-moving  average 

(ARMA)  processes,  of  orders  p  and  q,  often  written  as 

ARMA(p,q).   Box  and  Jenkins  [Ref.  4]  notes  that  for  many 

series  encountered  in  practice,  the  inclusion  of  both  AR 

and  MA  terms  in  a  model  results  in  fewer  total  parameters 

than  would  be  required  for  either  a  pure  AR  or  pure  MA 

process.   The  ARMA(p,q)  model  may  be  written  in  the  usual 

form  as 

Zt    =     *LZt-l  +    *2Zt-2  +  *  '  '  +  Vt-p  +  at  "  6lat-l  "    62at-2  "  '  '  '   -6qat-q; 
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in  the  more  compact  operator  notation,  the  same  model  is 
written 


c|>(B)zt   =   6  (B)at  . 


As    an   example,    an   ARMA(2,2)    model   would   be   written   as: 


(1  -  4>1B-  4>2B2)zt      =       (1  -  61B-  62B2)at    , 


or   expanded,    as: 


Zt   =   Vt-1  +  Vt-2  +  at  "  9lat-l  "  62at-2  ' 


Recall  that  with  differencing  or  other  transformation 

techniques,  a  stationary  series  can  be  obtained  from  a 

homogeneous  (seasonal  or  non-seasonal)  non-stationary  series. 

When  the  differencing  technique  is  integrated  directly  into 

the  ARMA  model,  the  result  is  an  integrated  autoregressive- 

moving  average  (ARIMA)  model.   The  model  is  often  written 

ARIMA (p,d,q) ,  where  p  and  q  retain  their  previous  meanings, 

and  d  represents  the  order  of  (non-seasonal)  differencing. 

The  model  may  also  be  generalized  by  including  an  additional 

constant  term  9   that  will  have  the  effect  of  adding  a 

o  3 

deterministic  polynomial  trend  of  order  d.   The  value  of  6 

o 

may  be  found  in  general  by  the  formula 
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>         =   \i   G    , 
o  ' 


where 


P  P 


G      =        [1    -       I    $±]  [1    -       I    <D    ] 


i=l         j=l 
The  general  ARIMA(p,d,q)  model  can  be  written  compactly  as 


(1)  <MB)  Vd  zt   =   G   +  9  (B)  a^  . 

t      o         t 


An  equivalent  form  for  ARIMA(p,d,q)  models  that  is 
sometimes  seen  is  called  the  undif ferenced  form: 


Y(B)  zt   =   6Q  +  6(B)  at  , 


where 


Y(B)   =   0(B)  Vd   =   (J)(B)  (1  -  B)d 


The  "differenced"  form,  equation  (1) ,  is  the  form  usually 
seen.   In  the  differenced  form,  the  transfer  function  cf>  (B] 
is  assumed  to  be  stable;  that  is,  all  the  roots  of  the 
difference  equation  <J>  (B)  =  0  are  outside  the  unit  circle. 
Clearly,  Y(B)  is  not  a  transfer  function  of  a  stationary 
series  when  d  >  0,  since  V(B)  has  d  roots  on  the  unit 
circle. 
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4 .   Seasonal  ARIMA  Models 

The  general  class  of  ARIMA  models  previously  dis- 
cussed can  be  further  generalized  to  allow  for  the  modeling 
of  seasonal  models  with  the  addition  of  appropriate  seasonal 
operators  and  parameters.   The  seasonal  model  is  called 
an  ARIMA  model  of  order  (p,d,q)  x  (P,D,Q)  ,  where  p,d,  and 
q  retain  their  previous  meanings,  and  P,  D,  Q  and  s  are  as 
defined  in  Section  A  of  this  chapter,  page  17.   The  ARIMA 
(P/cUq)  x  (P,D,Q)   model  can  be  written  as  the  product  of 
nonseasonal  and  seasonal  operators: 


cj)(B)<MBS)  VDVdz.   =   6   +  6(B)0(BS)a. 


As  an  example,  consider  the  ARIMA  (1,2,1)  x  (1,2,1) .p  model: 


(1-*lB'(1-*l,12Bl2)v2vi22  Zt   "   9o  +  (l-eiB)(l-6la2B12)at 


F.   THE  AUTOCORRELATION  AND  PARTIAL  AUTOCORRELATION  FUNCTIONS 

Mathematically,  the  autocorrelation  at  lag  k,  denoted 
p, ,  is  defined  as: 


P 


B[(z  -  y)(zt+k  -  u)] 


k  a2 

z 


The  autocorrelation  function  of  a  time  series  describes  the 
association  (mutual  dependence)  among  values  of  the  same 
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series  taken  at  different  time  periods,  the  difference  in 
time  being  referred  to  as  the  lag,  denoted  k.   Autocorrela- 
tion of  itself  implies  nothing  about  a  change  in  one 
variable  causing  a  change  in  another.   However,  the  auto- 
correlations may  provide  important  information  about  the 
structure  of  a  data  set  and  its  pattern.   In  a  set  of  com- 
pletely random  data  the  theoretical  autocorrelations  among 
successive  values  will  always  be  zero,  whereas  data  values 
of  strong  seasonal  or  cyclical  behavior  will  be  highly 
autocorrelated.   This  p,  can  be  estimated  using  the  time- 
averaged  sample  autocorrelation,  denoted  r,  ,  defined  as: 

N-k 

1  I    (z   -  z)  (z     -  z) 

N  t=l  t+K 

r, 


k  ;2 

Z 


A  plot  of  the  autocorrelation  function  versus  the  lag  k, 
called  a  correlogram,  is  very  useful  for  the  purpose  of 
determining  if  a  process  is  stationary  and  for  identifying 
the  appropriate  model. 

Another  function  useful  in  identifying  the  appropriate 
model  for  a  given  series  is  the  partial  autocorrelation 
function,   here  called  the  pauto  function.   Partial  auto- 
correlations are  analogous  to  autocorrelations  in  that  they 
indicate  the  relationship  of  the  values  of  a  time  series  to 
various  time-lagged  values  of  the  same  series.   However, 
they  differ  from  autocorrelations  in  that  they  measure  the 
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strength  of  the  relationship  between  values  of  the  series 
of  various  lags  after  the  effects  of  other  lags  have  been 
removed.   In  effect,  they  show  the  relative  strength  of  the 
relationship  that  exists  for  varying  time  lags.   For  time 
series  models  of  the  types  to  be  considered,  the  partial 
autocorrelation  coefficients  can  be  calculated  several 
ways.   One  method  of  calculation,  described  by  Box  and 
Jenkins  [Ref.  4,  Sec.  3.2.5]  begins  with  the  following 
equation,  satisfied  by  the  autocorrelation  function,  where 
the  <J),  are  autoregressive  parameters: 


pj   =  *klpj-l  +  '••  +  ^k,k-lpj-k+l  +  \kpj-k  '   j  =  1'2 k 


This  leads  to  what  are  known  as  the  Yule-Walker  equations, 
which  may  be  written 


pl    1 


'k-1 


1   •"   Mk-2 


pk-l  Pk-2    pk-3  ••    X 


♦kl 

pl 

♦k2 

p2 

• 

. 

kk 

pk 

Solving  these  equations  for  k  =  1,2,3,  ...,  successively, 
we  obtain 


11 


1  ' 
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P2  ~  Pl 
1  "  Pi 
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,  etc . 


In  general,  for  4>kkf  the  determinant  in  the  numerator  has 
the  same  elements  as  that  in  the  denominator,  but  with  the 
last  column  replaced  with  p..   The  quantity  <lVk '  a  functi°n 
of  the  lag  k,  is  called  the  partial  autocorrelation  function. 
Other  methods  for  calculating  partial  autocorrelations  include 
successively  fitting  autoregressive  processes  of  orders 
1,  2,  ...,  k  by  least  squares  and  picking  off  estimates  of 
<J>-|i/  ^??'  •••'  ^vv    °f  the    last  coefficient  fitted  at  each 
stage.   Another  method,  discussed  in  Appendix  A3 . 2  of 
Ref.  4  and  due  to  Durbin,  generates  estimates  of  an  auto- 
regressive process  of  order  k+1  recursively  from  estimates 
of  autoregressive  processed  orders  k  and  less.   It  is 
derived  by  observing  recursive  relationships  from  the 
Yule-Walker  equations.   The  recursive  formulas  are: 
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^+ltj   -   *k.  "  Ok+lfk+l^k-j+l  ' 


j    =    1,2,     .../    k,    and 


*k+l,k+l 


rk+l         -^kj    rk+l-j 

1  -  X*» rj 


Another  way  of  looking  at  partial  autocorrelations 
is  to  consider  a  time  series  {z  }  and  the  model 


Zt   =   bo  +  blZt-l  +  b2Zt-2  +  '••  +  bk-lZt-(k-l)  ' 


where  the  b  values  are  the  least  squares  estimates  of  the 
linear  regression  coefficients  (3's)  in  the  model 


zt  =   3o  +  3lzt-l  +  '••  +  \-izt-(k-l)  +  et 


Let  z   be  the  residual  of  z   after  removing  the  linear 

effect  of  z^  ,  ,  .  ..,  z,  .  ,,  from  z, ,  such  that  z.  =  z.  -  z^ 
t-1        t-k+1       t  t    t     t 

Then,  the  partial  autocorrelation  of  lag  k,  denoted  1  ,  , 
is  defined  to  be  the  simple  autocorrelation  of  lag  k  for 

the  adjusted  series  (z,,z„,  ...,  z  ). 

->  12         n 

The  exact  expression  for  partial  autocorrelations  of 
a  moving  average  process  is  complicated,  but  an  approximate 
duality  between  autocorrelations  of  an  autoregressive 
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process  and  pautos  of  a  moving  average  process  implies 
that  the  pautos  of  a  moving  average  process  would  have  the 
same  general  behavior  as  the  autocorrelations  of  an  auto- 
regressive  process  of  the  same  order.   This  approximate 
duality  also  implies  that  the  pautos  of  an  autoregressive 
process  of  order  p  will  have  the  same  general  behavior  as 
the  autocorrelations  of  a  moving  average  process  of  order 
p.   Thus,  one  function  can  be  examined  and  used  to  confirm 
the  other,  and  may  be  of  use  in  model  identification,  discussed 
in  section  G  of  this  chapter. 

G.   COMMENTS  ON  MODEL  SELECTION  EMPLOYING  AUTOCORRELATIONS 
AND  PARTIAL  AUTOCORRELATIONS 

The  purpose  of  this  section  is  to  provide  a  brief  over- 
view of  the  methodology  for  selecting  the  proper  model  for 
a  given  time  series,  through  both  examination  or  prior 
knowledge  of  the  data  itself  and  examination  of  plots  of 
the  autocorrelation  and  partial  autocorrelation  functions. 

A  not  yet  stationary  series  should  first  be  differenced 
or  transformed  until  it  appears  to  be  stationary;  character- 
istic of  the  autocorrelation  plot  (correlogram)  of  a  non- 
stationary  series  is  a  very  slow  damping  out  of  the  auto- 
correlations.  When  this  property  of  the  correlogram  is 
observed,  the  analyst  should  difference  the  series  until  no 
further  improvement  is  reached.   For  ARMA(p,q)  models,  the 
tentative  identification  of  the  model  class,  that  is,  the 
determination  of  p  and  q,  can  be  done  by  examining  the 
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sample  autocorrelation  and  sample  partial  autocorrelation 
functions  of  the  given  time  series  with  the  theoretical  auto 
and  pauto  functions  of  members  of  the  general  linear  class. 
For  most  stationary  time  series,  an  adequate  fit  can  be 
found  in  a  model  with  p  and  q  relatively  small,  say  three 
or  less. 

The  following  figure  displays  examples  of  autocorrela- 
tion and  partial  autocorrelation  versus  lag  plots  for  several 
basic  model  types,  described  in  Ref.  17. 

Figure  3.   Examples  of  Auto  and  Pauto  Plots 
Figure  3(a).   Auto  and  Pauto  vs.  Lag  for  AR(1)  Model 
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Figure    3(b).      Auto    and   Pauto   vs.    Lag    for   AR(2)    Model 
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Figure    3(c).       Auto   and   Pauto   vs.    Lag    for   MA(1)    Model 
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Figure  3(d).   Auto  and  Pauto  vs.  Lag  for  MA(2)  Model 
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Figure  3(e).   Example  Auto  and  Pauto  vs.  Lag  for 
Mixed  ARMA(1,1)  Model 
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As  can  be  seen  from  the  figures,  there  is  a  wide  variety 
of  possibilities  for  appearance  of  the  correlogram  and 
partial  autocorrelation  plots  for  even  the  simplest  of 
models.   Sometimes  the  pattern  of  estimated  autos  and  pautos 
can  be  quickly  classified  in  terms  of  one  of  the  simpler 
basic  models;  however,  most  real  data  will  generate  auto 
and  pauto  plots  that  resemble  those  of  Figure  3 (e) ,  those 
of  a  mixed  model.   Here  some  free  association  may  be  re- 
quired to  infer  a  pattern  from  the  correlogram,  or  more 
than  one  pattern  may  be  implied.   However,  most  of  the  time 
a  selection  of  something  is  possible.   As  is  evident,  this 
is  a  somewhat  subjective  process,  where  the  quality  of 
identification  will  improve  with  experience. 

The  following  table,  adapted  from  Box  and  Jenkins 
[Ref.  4],  summarizes  the  properties  of  autoregressive , 
moving  average  and  mixed  ARMA  processes;  an  understanding 
of  its  contents  will  be  helpful  as  thumbrules  for  initial 
model  identification. 

It  can  be  noted  from  examination  of  Table  II  that  there 
exists  what  can  be  termed  a  "duality"  relationship  between 
the  autocorrelations  and  partial  autocorrelations  of  pure 
autoregressive  and  moving  average  processes.   For  example, 
the  plot  of  autocorrelation  versus  lag  for  an  AR(p)  process 
would  appear  the  same  as  the  plot  of  partial  autocorrela- 
tion versus  lag   for  an  MA(q)  process,  for  p  =  q.   Similarly, 
the  plot  of  partial  autocorrelation  versus  lag  for  the  AR(p) 
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Autoregres  s  ive 
Process 


Moving  Average 
Process 


Mixed 
Process 


Model  in  terms 
of  previous 
z  values 


<D  (B)  z  -  afc 


zfc  =  6(B)  at 


(B)  zt  =  9  (B)  Zl 


Autocorre lation 
Function 


Infinite  and  tails 
off;  composed  of 
damped  exponentials 
and/or  damped  sine 
waves 


finite ;  that 
is,  there  will 
be  q  non-zero 
autocorre lat ions 


Infinite  and 
tails  off; 
composed  of 
damped  exponen- 
tials and/or 
damped  sine  waves 
after  the  first 
q-p  lags 


Partial 

Autocorrelation 

Function 


finite;   that  is, 
there  will  be  p 
non-zero  partial 
autocorre lat ions 


Infinite  and 
tails  off; 
dominated  by 
damped  exponen- 
tials and/or 
sine  waves 


Infinite  and 
tails  off; 
composed  of 
damped  exponen- 
tials and/or 
sine  waves  after 
the  first  p-q 
lags 


Table    II.       Properties    of    Basic   ARMA   Processes 

process   would   appear    the    same    as    the    plot   of    autocorrelation 
versus    lag    for    an  MA(q)    process,    where   p   =   q. 

For    seasonal    series,    where   differencing   has   been   unable 
to   remove    all    the   nonstationary    seasonal    behavior,    the    auto- 
correlation  and   partial    autocorrelation   plots   will    generally 
exhibit    a    "spike"    at    lags   equal    to    integer   multiples   of    the 
period   of    seasonality.       For   example,    if    the   data   are    seasonal 
with   a   period   of    12,    then    the    autocorrelations 
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r,„,  r„.,  r-r,     ...    and  the  partial  autocorrelations 
LZ  ZQ  Jo 

d),  „  ..  „ ,  A-.  „„,  d>_,.  -,,,  ...  would  be  amplified.   This  would 

LZ  ,  LZ  Zh  ,  Zh  Jo  /  Jo 

indicate  a  need  for  one  or  more  seasonal  parameters  to  be 
included  in  the  model.  The  following  figure  is  an  illus- 
tration of  such  an  auto/pauto  plot. 


Figure  4.   Example  Auto  and  Pauto  versus  lag  for  mixed 
ARMA(p,q),  with  seasonality  remaining  of 
period  s  =  6. 
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H.   ESTIMATION  OF  MODEL  PARAMETERS 

Suppose  a  time  series  has  been  tentatively  identified 
as  an  ARIMA(p,d,q)  model: 


(MB)  V   z 


)   +  6(B)  a,  . 
o  t 


There  are  then  p+q+2  unknown  parameters  of  the  model  to  be 

2 
estimated,  ((}),, d)~,  ...,  d>  ,6  ,6-.,0of  ...,  0  ,o    ).   The 
1  r2        Yp   o   1   2         q   a 
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Box-Jenkins  procedure  separates  this  estimation  into  two 
parts.   First,  estimates  are  obtained  for  the  AR  and  MA 

parameters  $=   ($,,  <pj,    .  ..,  $    )  and  6  =  (6.(9.,  •  .-,  9  ); 

2 

then  estimates  are  calculated  for  6   and  a  ,  which  are  func- 

o      a 

tions  of  0  and  9 . 

The  usual  procedure  is  to  select  those  parameter  values 
(J)  and  6  that  minimize  the  sum  of  squared  model  errors 
(residuals).   Let  y   =9  /(l  -  <j>_  -  cj)0  -  .  .  .  -  <j)  )  and 

W      O  _L       ^-  p 

W^  =  V  (z.  -  y  ) •   Then,  it  can  be  shown  that  y   =  EtVT] 
t        t     w  w       t 

and  that  the  model  can  be  rewritten  as 


(J>(B)  (Wfc  -  yw)   =   9(B)  at  , 


or 


at   =   9  1(B)  (()(B)  (Wt  -  yw)  . 


Now,  let  W,  the  sample  mean,  be  the  estimate  of  y   (if 
'  c  w 

d  >  0,  then  y   is  usually  zero).   Also,  let 
w  :L 


a    =   9_1(B)  $(B)  (Wfc  -  W) 


Set 

N 
S(£,9)   =   £  a^  , 
t=l 

where  N  =  n-d  is  the  length  of  the  differenced  series.   The 
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objective  is  to  select  those  parameters  $_   and  6_  such  that 
S(£,8_)  is  minimized  over  all  values  of  the  (p+q) -dimensioned 
parameter  space.   Since  the  equation  in  S  is  nonlinear 
in  the  parameters,  iterative  search  methods  are  generally 

used  to  determine  optimal  model  parameters.   Having  found 

2 
these  optimal  parameters  and  the  minimum  S,  o   can  be 

estimated  using 


aa   =   S($,6)/N-p-q  . 

a.  —  — 


Chapter  III  contains  a  more  detailed  description  of  a 
nonlinear  algorithm  to  estimate  parameters  of  a  generalized 
seasonal  or  nonseasonal  ARIMA  model. 

I.   DIAGNOSTIC  CHECKING  OF  MODELS 

After  the  model  has  been  tentatively  identified  and 
parameter  estimates  have  been  calculated,  the  next  task  is 
to  test  whether  or  not  the  original  model  specification 
was  correct  and  that  the  model  itself  is  adequate  in  fore- 
casting power.   The  process  of  testing  the  model  can  take 
many  forms,  but  will  usually  include  at  least  the  following 
two  steps: 

1.   Generate  a  simulated  series  from  the  estimated 
model  and  compare  the  simulated  series  and  its 
auto  and  pauto  functions  with  the  original  series 
and  its  respective  auto  and  pauto  functions.   This 
comparison  is  essentially  subjective. 
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2.   Calculate  the  residuals  of  the  estimated  model,  the 
a  's,  and  compare  the  properties  of  the  residuals 
with  those  assumed  for  the  shock  terms  of  the  actual 
process.   The  residuals  should  be  normally  distri- 
buted and  uncorrelated  with  each  other;  that  is,  there 
should  be  no  discernable  structure  in  the  residuals. 
There  are  many  quantitative  statistical  tests  and 
data  analytic  tools  that  can  be  applied  to  the 
residuals  to  test  hypotheses  of  normality  and  zero 
autocorrelation . 
A  plot  of  the  autocorrelation  and  partial  autocorrelation 
functions  of  the  residuals  will  provide  not  only  a  test  of 
whether  or  not  the  residuals  are  uncorrelated,  but,  if  they 
are  correlated,  the  plots  can  be  used  to  suggest  improve- 
ments to  the  model.   For  example,  suppose  the  model  was 
tentatively  specified  as  the  ARMA(1,1)  model  below: 


(1  -  0.5B) (z   -  2)   =   (1  +  0.7B)  at 


Suppose  also  that  the  autos  and  pautos  of  the  model  residuals 

suggested  the  model  (1  -  0.3B)  a   =  u  ,  where  the  u  ' s 

2 
are  white  noise,  uncorrelated  with  variance  a  .   Then, 

u 

these  two  models  can  be  combined  into  the  ARMA(2,1)  model: 


(1  -  0.3B)  (1  -  0.5B)  (z   -  2)   =   (1  +  0.7B)  ufc 


This  should  be  a  refinement  over  the  original  model 
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J.   FORECASTING 

The  objective  in  forecasting  is  to  predict  future 
values  of  the  time  series  with  as  little  error  as  possible. 
The  criterion  most  often  used  for  forecasting  is  to  calcu- 
late that  forecast  which  minimizes  the  expected  mean  square 
forecast  error.   Therefore,  if  z  (&)  denotes  the  forecast 
for  lead  time   £  from  time  origin  t  of  the  value  z   - , 
the  objective  is  to  find  z  (£)  such  that  the  objective 
function 


Et(zt+£  -  St«)2] 


is  a  minimum.   This  forecast  is  given  by  taking  z  (I)    as 
the  conditional  expectation  of  z    ,  given  z,  ,  ...,  z  : 


zfcU)      E[zt+Jzt,zt-1'  "•'  Zl]  * 


The  forecast  can  be  easily  generated  recursively  from  the 
mathematical  model,  utilizing  the  facts  that 


E[zt-j 'Zt' ' ' ' 'Zl]      Zt-j  ' 


for  j  =  0,1,2...  (where  t  is  the  current  time),  and 


Etzt+i  I  zt'  *  *  *  ,Z1^   =   zt(^'  for  ^  =  1'2, 
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and 


E[afc]   = 


for  times  >  t 


a       for  times  <_  t 


For  example,  consider  the  Box- Jenkins  model 


(1  -  0.5B  +  0.6B2)  z    =   (1  +  0.3B)  a 


which  could  be  written  in  the  expanded  form  as 


z^   =   0.5z^  ..  -  0.6z^  „  +  a^  +  0.3  a,  ,  . 
t         t-1       t-2     t        t-1 


Now,  assume  it  is  known  that  z,nf)  is  1.4,  zqq  is  1.0,  and 
the  calculation  has  been  made  to  obtain  the  residual 
a,nn  =  0.2.   Then  the  forecasts  of  z,ni,  z-in?  anc^  zim 
made  from  an  origin  of  t  =  100  can  be  calculated  from  the 
model  as  follows: 

first,  for  1   =    1,    set 


Z100(1)   "   E[z10llZ100'Z99' * ' * ,Z1]  ' 


z100(l)   =   E[0.5z1()0  -  0.6z99  +  a1Q1  +  0.3a10Q]  , 


and 
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z100(l)   =   (0.5)  (1.4)  -  (0.6)  (1.0)  +  0  +  (0.3)  (0.2)  ; 


then  our  forecast 


^qqU)   =   0-7  -  0.6  +  0.06   =    0.16   ; 


Next,  for  £  =  2,  set 


z10Q(2)      E[z102lZ101'Z100/Z99' * ' * /Z1]  ' 


z100(2)   =   E[0.5z101  -  0.6z10()  +  a1Q2  +  0.3a1Q1 


Z100'Z99' *  *  * 'Zl]  ' 


z10Q(2)   =   (0.5)  (z100(l))  -  (0.6)(z10())  +  0  +  0  , 


z10Q(2)   =   (0.5)  (0.16)  -  (0.6)  (1.4)   =    -0.76   ; 


similarly,  for  Z   =    3,  set 


z100(3)      E[Z103|Z102,Z101/Z100,Z99,• '* /Z1]  ' 


z1()0(3)   =   E[0.5z1()2  -  0.6z101  +  a1Q3  +  0.3a1Q2 


Z100'Z99"**'Z1] 


z100(3)   =   (0.5)  (z10Q(2))  -  (0.6)  (z100(D)  +  0  +  0  , 
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and  then 


z10Q(3)   =   (0.5)  (-0.76)  -  (0.6)  (0.16)   =    -0.4 


Clearly,  this  process  can  be  continued  into  the  future  as 
long  as  desired,  recognizing  that  the  expected  forecast 
accuracy  will  decrease  as  I    increases. 
Let 


et(£)        (zt+*-zt(£)» 


denote  the  forecast  error  for  lead  time  I   beyond  the  forecast 
time  origin  t.   It  can  be  shown  that  e  (I)    is  given  by 
the  relation 


etU)   =  at+i    +   ^lat+£-l  +  ••'  +  ^£-lat+l  ' 


where  the  scalar  weights  \p  .    are  determined  from  the  equation 


iMB)   =  i    1(B)  (1  -  B)  d  0(B) 


using  the  known  parameter  values.   The  variance  of  the 
forecast  error  is  given  by 


£-1 
E[(e£(*)]  =  (1    +   ^1+    ...  +  ip^_x)  (o2a)    =  {1  +  I    ^}o2a 

j=l 
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From  these  relationships,  a  confidence  interval  of  n 
standard  deviations  about  a  forecast  of  lead  time  I   would 
be  given  by: 

£-1 

I  . 
D       a 


n   2  1/2 
cn(ztU))   =   ztU)  ±  n[l  +  I    ty  A 


j=l 


The  value  of  n  could  also  be  thought  of  as  the  percentage 
point  for  the  desired  level  of  confidence  using  the  Normal 
distribution  [Ref.  4].   It  can  be  noted  from  the  definition 
of  e  (£)  above  that  the  one-step-ahead  forecast  error, 
e  (1)  is  simply  the  value  a . +1 ;  that  is, 


Zt+1  "  Zt(1)   =   et(1)   =   at+l  • 


This  is  an  explanation  for  the  use  of  the  term  "residual" 
to  refer  to  the  white  noise  or  shock  terms.   Additionally, 
from  the  foregoing  it  is  evident  that  the  forecast  error 
variance  is  a  non-decreasing  function  of  the  length  of 
the  forecast  lead  time  I;    therefore,  the  confidence  bands 
must  become  wider  as  the  forecast  lead  time  increases. 
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III.   GENERALIZED  ARIMA  MODEL  PARAMETER  ESTIMATION 

The  purpose  of  this  chapter  is  to  describe  the  compu- 
tational details  of  the  algorithm  WMARQRDT,  employed  with 
appropriate  subroutines  to  estimate  Box-Jenkins  parameters 
of  a  generalized  seasonal  (or  non-seasonal)  ARIMA  model. 
This  generalized  model  can  be  written  parsimoniously  as 
follows : 

cj)  (B)  $(BS)W.   =   6  +e(B)0(BS)a.  , 


where 


ndnD  . 

wt  is  v  vdz;, 


and 


z'  is  the  transformed  time  series  (for  example, 


z't   =    In  zt   or   z;  =  /zfc)  . 


The  model  employs  a  Marquardt-type  [see  Ref.  13]  non- 
linear least  squares  algorithm  for  determination  of  the 
model  parameters,  searching  in  the  parameter  space  for  the 
set  of  parameters  which  minimizes  the  sum  of  the  squared  model 
residuals . 
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A.   MATHEMATICAL  DISCUSSION  OF  THE  MARQUARDT  ALGORITHM 
Reference  13  describes  Marquardt * s  methodology  for 
development  of  a  general  algorithm  for  least-squares  esti- 
mation of  nonlinear  parameters.   Most  algorithms  for  least- 
squares  estimation  of  nonlinear  parameters  have  been  cen- 
tered about  either  a  pure  linear  iterative  model  based  on 
a  Taylor  series  expansion  or  using  some  form  of  the  method 
of  steepest  descent  (maximum  negative  gradient) .   Since 
both  methods  have  severe  potential  pitfalls  (Taylor  series 
due  to  divergence  of  the  iterates  due  to  an  unfortunate 
choice  of  initial  values,  the  steepest  descent  due  to  slow 
convergence  after  the  first  few  iterations) ,  a  method  termed 
"Maximum  neighborhood"  method  was  developed  by  Marquardt 
which,  in  effect,  performs  an  optimum  interpolation  between 
the  Taylor  series  method  and  the  method  of  steepest  descent, 
the  interpolation  being  based  upon  the  maximum  neighborhood 
in  which  the  truncated  Taylor  series  gives  an  adequate 
representation  of  the  nonlinear  model. 

As  discussed  in  Ref.  14,  the  idea  of  Marquardt 's  method 
can  be  briefly  explained  as  follows.   Assume  the  algorithm 

begins  with  a  vector  of  initial  parameters   (cj)  ,  $  ,6  ,0  ). 
^  ^  o   o   o   o 

If  the  method  of  steepest  descent  is  applied,  a  certain 
vector  direction  h  ,  where  the  subscript  g  represents  the 
gradient  (which  gives  the  direction  in  which  the  rate  of 
change  is  the  greatest) ,  is  obtained  for  movement  away  from 
the  initial  point  values  in  the  parameter  space.   Due  to 
potential  nonlinearities  in  the  sum-of-squared-residuals 
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surface,  S(<fc  ,  §  ,0  ,0  ),  in  the  parameter  space,  h   may 
o   o   o   o  9 

be  the  best  local  direction  in  which  to  move  toward  opti- 
mality  (minimal  sum  of  squared  model  residuals) ,  but  may 
not  be  the  best  direction.   However,  the  best  direction 
must  be  within  90  degrees  [Ref.  8]  of  h  ,  or  else  the 
value  of  S  ((J) ,  $,  6  ,  0)  will  increase  locally.   Now,  the 
linearization,  or  Taylor  series  method,  may  result  in  a 
different  correction  vector,  h  .   Marquardt  found  experi- 
mentally that  for  a  number  of  practical  problems,  the  angle, 
say  £,  between  the  vectors  h   and  h  ,  fell  in  the  range 
80  degrees  <  £  <  90  degrees.   In  other  words,  the  two 
directions  were  nearly  normal  in  most  cases.   The  Marquardt 
algorithm  then,  provides  a  method  for  interpolation  between 
the  vectors  h   and  h  ,  employing  a  suitable  step  size,  which, 
in  general,  converges  more  quickly  than  either  of  the  two 
"parent"  methods  alone.   The  remainder  of  this  section  des- 
cribes the  mechanics  of  the  algorithm,  as  applied  to  the 
estimation  of  Box-Jenkins  parameters. 

B.   MODEL  INPUT  INFORMATION 

The  following  is  the  required  input  information  to 
the  WMARQRDT  parameter  estimation  model: 


{W|}  the  transformed  time  series  (for  example, 

W'  =  In  z  ,  or  W'  =  /z7 

N  the  length  of  the  time  series 

s  the  length  of  the  seasonal  period  (for  no 

seasonality,  s  =  1) 
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P  the  number  of  seasonal  AR  parameters,  P  >_  0 

p  the  number  of  non-seasonal  AR  parameters, 

p  21  o 

Q  the  number  of  seasonal  MA  parameters,  Q  >_  0 

q  the  number  of  non-seasonal  MA  parameters, 

q  >  0 

NDIFNS         the  number  of  non-seasonal  differences  to 
be  taken 

NDIFS  the  number  of  seasonal  differences  to  be  taken 


=  ($,   ,  .  .  .  ,  <3>    )      initial  estimates  of  seasonal  AR 
1,  s      P,s  . 

'  parameters 


(J)  =  (0,  ,(})_,...,  <j>  )       initial  estimates  of  non-seasonal 

^        AR  parameters 


0  =  (0n   ,  0~   , . . . , 0^   )      initial  estimates  of  seasonal 
1, s   2  ,  s       Q,s 

MA  parameters 


=  (9  ,6  ,  ...,  6  )  initial  estimate  of  non-seasonal 

^  MA  parameters 


C.   ALGORITHM  DESCRIPTION 

Initially,  the  model  accepts  inputs  of  the  time  series 
length  and  the  (transformed,  but  undif f erenced)  time  series 
itself  from  the  user's  disc,  where  it  is  stored  in  File 
FT02F001.   The  remainder  of  the  input  data  is  then  entered 
interactively  on  the  terminal  as  prompted  by  the  model.   The 
model  then  forms  the  initial  parameter  estimates  into  vectors 
of  lengths  p,  P,  q,  and  Q,  and  employs  them  to  calculate 
an  initial  model  residual  sum  of  squares. 
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Prior  to  initiating  the  sum  of  squares  calculation  pro- 
cess, the  model  unravels  the  polynomial  of  AR  and  MA  operators, 
and  forms  a  vector  of  coefficients  for  both  the  AR  and  MA 
sides  of  the  model.   For  example,  consider  the  relatively 
simple  (2,1)  x  (2,1)  _  ARIMA  model,  written 

(l-^B-cJ^B2)  (1  -  $1    12Bl2)Wt      (l-61B-e2B2)  (l-01^12B12)at. 

Unraveling,  the  model  becomes  first: 

d-^B-^B2)  <Wt-*lfl2Wt_12)   -   (l-eiB-e2B2)  (at-G1/12at_12)  , 

and  then  takes  the  form: 

Wt-$l,12Vl2-*lWt-l+*l$l,12Wt-13-*2Wt-2+^2$l,12Wt-14 


—   z,  fc)-i  _„a   ,„  y,a   .,  +  y  _  (J  n  _„a.  ..  _  —  9  ~  a   _ +  u  _  0 ,  ..  _  a ,  ,. 
t   1,12  t-12   1  t-1   1  1,12  t-13   2  t-2   2  1,12  t-14 . 


This  is  represented  in  the  computer  as  four  vectors:   two 
vectors,  tt  and  y ,    composed  of  the  expansion  AR  and  MA 
coefficients  respectively,  and  two  vectors  composed  of  the 
indices  of  the  time  series  terms  associated  with  the  coeffi- 
cients.  For  the  model  in  the  example  above,  these  vectors 
would  be  written  as  follows: 


7T    = 


(ll^lfl2f(Pll(<t>1)(\fl2)^2f(^2)    (*1/12>> 


INDEXAR   =   (0,  12,  1,  13,  2,  14) 


Y   =   (l^ifi2'0r(ei>^l/12)'e2'(e2)(QLf12) 
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INDEX^   =   (0,   12,   1,   13,   2,   14) 


This  format  for  unraveling  of  a  generalized  product  of 
polynomials  of  seasonal  and  non-seasonal  parameters  permits 
simplified  calculations  in  the  determination  of  the  sum  of 
squared  residuals,  since  the  arithmetic  need  only  be  per- 
formed for  the  non-zero  parameter  values,  those  contained 
in  the  tt  and  y   vectors.   In  the  actual  calculations,  per- 
formed in  FORTRAN,  the  index  vector  origin  is  translated 
to  the  right  by  the  amount  p  +  Ps  +  q  +  Qs,  called  IADDIT 
in  the  model,  in  order  to  prevent  obtaining  zero  or  negative 
subscripts . 

The  calculation  of  the  residual  sum  of  squares  is  a 
three  stage  process.   First,  the  model  calculates  ten 
values  of  e  ,  the  "forward"  white  noise  terms,  using  the 
following  relationship: 

p+Ps  q+Qs 

e.   =  W.  -   y  -rr.Vtf   .   +   7  y  .e.  ,  . 
t  t  L        i  t-i      L        j    t+j 

i=2  j=2 

The  assumption  is  made  that  (e, ,  e, „,..., e  )  are  all  equal 

to  zero.   Having  found  the  desired  values  for  (e,n,e.,... ,ej , 

we  can  now  backcast  the  necessary  values  of  W  ,  in  order 

to  enable  us  to  calculate  the  required  white  noise  terms 

a  ,  as  follows: 
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p+Ps  q+Qs 

Wt   =   et  +  I      ^t+i  "  I      ^jet+j 
i=2  j  =  2 


solving  for  (Wq/W_1/W_2 , . . .  r^±_ (p+sP+q+sQ) ) •   Now,  with  the 
W  ' s  backcast,  we  can  proceed  to  calculate  the  estimated 
white  noise  terms  (residuals)  using  this  relationship: 


p+Ps  q+Qs 

a .   =   W.  -  J      7T  .  W.  .  +   7   y  •  a4_ 

t       t     L         1  t-i  ''   ']  t-' 

i=2  j=2 


The  values  of  a   are  calculated  for  t  =  1,  . . . ,  N.   Once  the 
a  ' s  are  calculated,  it  is  a  simple  matter  to  calculate  the 
sum  of  squares,  using 


N 
S  (((>,$,  0,0)   =    j  a| 

t=l 


Having  calculated  the  residual  sum  of  squares  for  the 
initial  parameter  estimates,  we  form  the  parameters  into 
a  vector  3/  such  that 


3  —   ( 3 -I  /  3^  i    '  -  •  i    3,  )  / 


where  k  =  p+P+q+Q  ;  that  is, 


(*1 V$l,s Vs'Gl V°d,s °Q,s 
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The  subroutine  PARSH  then  calculates  the  derivatives 

!!t 

xi,t       36   ' 
i 

over  all  values  of  t  =  1,...,N  and  i  =  l,...,k.   Using  the 
residuals  {a  }  calculated  earlier,  the  derivatives  are 
estimated  numerically  using  a  perturbation  of  each  parameter 
of  amount  6 ,  such  that 


xi  t  =   {at(Bi"-  "3k)-at(31,..  w3i+6/.  .  .  ,3R)  }/6  , 


Then  with  {a  }  and  x.    supplied  for  the  current  parameter 
values,  the  following  quantities  are  formed: 


1.   The  kxk  matrix   A   =   {A.  .}  ,  where 


N 
"ID 


*  ^t^j,^ 


t=l 


2.   the  vector  G   =   {g. }  ,  where 


N 

gA  =  l    <xi/t)(at) 

t=l 


3.   the  scaling  quantities   D.   =   /A. . 
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Then,  the  modified  (scaled  and  constrained)  linearized 
equations 

[A*]  [h*]   =   [g*] 

are  formed,  where 


A..*   =   A../D.D.  ,   i  ±   j  , 


A. .*   =   A. .*  +   £,   £  =  .01  , 
n        li 


and 


g. *   =   g./D.  . 
^i      ^ii 


It  can  be  noted  here  that  the  [A. .*]  matrix  is  in  fact  a 

13 

correlation  matrix  for  the  model  parameters.   Those   equa- 
tions are  then  solved  for  h*,  which  is  scaled  back  to  give 

the  parameter  correction  vector  h . ,  where 

3 


h.   =   h.*/D.  . 
3  3         3 


Then,  the  new  parameter  values  are  formed  from  the  h  vector, 
such  that 


6NEW   "   3OLD  +  h  ' 
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and  the  sum  of  squared  residuals  for  the  3X„-,TT  set  of 

NEW 

parameters  is  calculated. 

Now,  if  S(3„TT7T7)  <  S(3_Tr.),  the  parameter  corrections  h 
are  tested.   If  all  elements  of  the  h  vector  are  smaller 
than  some  epsilon,  say  .0001,  then  convergence  is  assumed 
and  the  kxk  matrix  [A*]    is  used  to  calculate  the  covari- 
ance  matrix  of  the  estimates;  otherwise,  8     is  reset  to 
3MFW/  the  constant  £  is  reduced  by  a  factor  F,  say  .1,  and 
computation  returns  to  the  calculation  of  a  new  set  of 
derivatives. 

However,  if  S(3.TT:,T7)  >  S(3_T_1),  the  constraint  parameter 

NEW         UJ_iJJ 

E    is  increased  by  the  factor  F,  and  computation  is 
returned  to  the  stage  where  the  A  matrix  is  formed.   In 
all  but  unusual  cases,  a  minimal  sum  of  squares  will  be 
found.   However,  an  upper  bound  can  be  placed  on  E, ,  and 
when  it  is  exceeded,  the  search  is  terminated.   When  con- 
vergence is  reached,  the  desired  output  information  is 
calculated. 

D.   MODEL  OUTPUT  AND  DIAGNOSTIC  CHECKS 
The  output  includes: 

1.   3  =  (3-,/--«f3k)      the  least-squares  estimates  of 

*!'  *  *  "  'V 


,  .  .  .  , 


D,  ,...,D 

1       q 

e1,...,oQ 
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2.   a  the  residual  variance, =— —  S($,$,§,0) 

a  N~ p— cj  — P— Q 


3.   V  the  covariance  matrix  of  the  parameter 

estimates,  formed  from 

V  =  {V. .}  =  (AXA)  L    a 
i  j  a 


4.   s.  the  standard  errors  of  the  parameter 

estimates , 


S±  =  /v77  ,   i  =  1,  .  .  .  ,p+q+P+Q 


5.   R. .  the  correlation  matrix,  obtained  from 


R.  .  =  V../  /V. .V.. 
ID     ID     ii  DD 


6.   0  the  overall  constant  term,  where 

o  A 

9   =  jj  G  ,  for 
o    M 

P  P 

G   =   (1  -  I    $±) (1  -   £  $.)   and 
i=l         j=l 

N 

^  =   I  J  wt 
t=i 

Finally,  diagnostic  checks  on  the  model  are  performed 

This  includes  calculation  of  residual  autocorrelations 

r~~ (k) ,  obtained  from  these  formulas: 
aa 


r~Mk)   =   c~~  (k)  /c~~  (0)  , 
aa         aa     aa 
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where 


N-k 


aa 


(k)   =  i  I  (at  -  a)  (at+k  -  a)  , 


t=l 


N 


"   N  I    at  ' 


t=l 


and  k  goes  from  1  to  the  maximum  desired   lag  K,  usually 
40.   Additionally,  a  chi-square  statistic  is  calculated 
from 


K 


X/  \   =   N   7  r*Mk)  , 
A (v)         ^   aa 

k=l 


and  is  compared  with  a  chi-square  distribution  with 
v=K-p-q-P-Q  degrees  of  freedom. 

Examples  of  input  methodology  and  appearance  of  output 
for  this  model  are  contained  in  later  chapters  of  this 
paper. 
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IV.   DESCRIPTION  OF  THE  TIME  SERIES  EDITOR 

In  this  chapter,  descriptions  are  given  for  each  of 
those  programs  in  the  Time  Series  Editor  which  interact 
with  the  user.   There  are  fifteen  separate  program  modules 
currently  included  in  the  Editor;  there  are  other  programs 
utilized  by  the  Editor  that  are  completely  transparent 
to  the  user,  and  are  not  described  here.   However,  listings 
for  all  programs  contained  in  the  Editor  are  provided  in 
Appendix  D  to  this  report. 

No  attempt  is  made  in  this  chapter  to  describe  the 
actual  mathematical  calculations  or  algorithms  that  are 
performed  by  the  programs.   Rather,  the  objective  is  to 
provide  general  descriptions  of  what  each  program  can  do 
for  the  user,  and  how  the  user  interacts  with  the  programs. 
The  programs  described  in  this  chapter  are,  in  the  order 
presented:   TIMESER  EXEC,  ZFORMAT,  CMSWORK,  TRANS,  DIFF, 
PLOT,  AUTO,  ESTIMATE,  YESTSEAS ,  WMARQRDT,  XSUMSQ,  FORECAST, 
ROOTS,  SIMULATE  and  GENERATE,  and  HELP. 

A.   THE  EXECUTIVE  PROGRAM 

The  heart  of  the  Time  Series  Editor  is  a  master  program 
called  TIMESER  EXEC  which  provides  file  control  for  all  of 
the  other  program  modules,  controls  input  and  output,  super- 
vises the  necessary  CP/CMS  protocol  and  provides  instructions 
interactively  to  the  user  concerning  the  contents  of  the 
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Time  Series  Editor  and  how  each  program  can  be  used. 
The  TIMESER  EXEC  program  is  written  in  the  IBM-360  CP/CMS 
Executive  language.   It  is  the  only  program  in  the  package 
not  written  in  FORTRAN;  consequently,  it  should  be  the  only 
program  that  would  need  modification  if  the  Editor  were  to 
be  adapted  to  another  FORTRAN-capable  time-sharing  system. 

After  the  user  has  logged  into  CP/CMS  and  linked  to 
the  disc  space  containing  the  Time  Series  Editor  (instruc- 
tions for  this  procedure  are  provided  in  detail  in  the 
User's  Guide  to  the  Time  Series  Editor,  included  as  Appendix 
A  to  this  report) ,  the  entire  Editor  package  is  made  avail- 
able to  the  user  by  the  command  TIMESER.   On  entry  of  this 
comand,  the  executive  routine,  TIMESER  EXEC,  can  provide 
a  guided  tour  through  the  Editor.   It  will  briefly  des- 
cribe what  the  Editor  can  provide  and  asks  the  user  what 
option  he  wants  to  use.   On  the  basis  of  the  user's  response, 
the  Editor  then  advises  the  user  what  input  data  is  required 
and  how  it  should  be  entered,  either  through  a  data  file 
entered  offline  or  parametric  data  entered  interactively 
at  the  terminal.   When  the  user  selects  an  option  for  exe- 
cution, the  TIMESER  EXEC  routine  loads  the  appropriate  pro- 
gram package  and  automatically  manipulates  the  required 
input  and  output  data  files.   For  the  more  experienced  user 
who  does  not  require  detailed  user  instructions,  there  is 
a  shortened  version  of  the  TIMESER  EXEC.   Upon  entry  into 
the  shortened  version,  the  user  is  immediately  asked  which 
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option  he  desires.   This  version  of  the  Editor  is  entered 
by  adding  the  argument  "s"  when  logging  into  the  Editor; 
that  is,  type  TIMESER  S  when  logging  in.   The  TIMESER  S 
(shortened)  version  of  the  Editor  provides  exactly  the 
same  program  options  to  the  user  as  the  longer  TIMESER 
version. 

B.   DATA  AND  FILE  MANAGEMENT 

Whenever  data  is  required,  the  user  is  prompted  at 
the  terminal  by  either  the  TIMESER  EXEC  or  the  program 
module  being  executed.   In  most  cases,  the  necessary  user 
response  is  a  short  alphanumeric  character  input  during 
execution  using  the  terminal  keyboard.   However,  when  the 
time  series  data  itself  is  entered,  the  user  may  enter  the 
data  by  card  deck  offline.   Similarly,  most  output  is  pro- 
vided right  at  the  user's  terminal.   Output  such  as  listings 
of  transformed  series  or  plots  are  sent  to  the  offline 
printer  to  conserve  time  and  provide  hard  copies  of  the 
results.   Detailed  descriptions  of  the  input  and  output 
requirements  of  each  program  module  are  provided  in  this 
chapter,  and  also  in  abbreviated  tabular  form  in  Appendix 
A,  the  User's  Guide.   However,  there  are  some  general  prin- 
ciples of  data  management  that  apply  to  all  programs. 
These  are  described  in  this  section. 

1.   Offline  Data  Entry 

The  Time  Series  Editor  requires  that  the  user's  time 
series  reside  in  FILE  FT02F001.  The  data  can  be  read  offline 
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via  cards  and  directed  to  FILE  FT02F001.   An  example  of  the 
required  format  for  the  input  card  deck  for  the  Time  Series 
Editor  is  provided  in  Figure  5.   It  is  noted  here  that  the 
data  format  expected  by  all  programs  is  FORMAT (5F15 . 6) , 
preceded  by  a  card  containing  the  length  of  the  time  series 
in  FORMAT (13) . 

2.   ZFQRMAT  Program 

In  many  cases,  the  user  will  want  to  analyze  time 
series  data  that  are  already  available  in  a  format  other 
than  that  required  by  the  Editor.   To  spare  the  user  the 
tedious  task  of  retyping  his  deck  in  the  required  format, 
the  ZFORMAT  program  was  written.   This  program  converts  a 
time  series  data  file  (FILE  FT03  001)  written  in  any  FORTRAN 
format  into  the  proper  FORMAT (5F15 . 6)  onto  FILE  FT02F001. 
The  length  of  the  series  is  entered  as  an  input  on  the 
terminal.   The  data  are  then  ready  to  use  in  the  Editor, 
with  the  original  file  left  in  FILE  FT03F001.   Figure  6 
shows  a  sample  input  deck  for  such  non-standard  data. 
Figure  7  gives  a  sample  session  where  ZFORMAT  is  used. 
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timeser  s 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

z 

IS  YOUR  DATA  IN  FILE  FT03F001? 

Y 

EXECUTION  BEGINS. . . 

IS  YOUH  TIME  SERIES  DATA  NOW  IN  FILE  FT03F001? 

y 

ENTER  THE  LENGTH  OF  YOUR  TIME  SERIES  VIA  FORMAT  13. 
010 

NOW  ENTER  THE  FORTRAN  FORMAT  FOR  YOUR  TIME  SERIES  DATA, 
INCLUDING  PARENTHESES;  FOR  EXAMPLE,  TYPE:  (5F15.7). 
fl0.2 

YOUR  FORMAT  IS: 
FORM AT Fl 0.2 
IS  THIS  CORRECT? 
n 

NO/v  ENTER  THE  FORTRAN  FORMAT  FOR  YOUR  TIME  SERIES  DATA, 
INCLUDING  PARENTHESES;  FOR  EXAMPLfc,  TYPE:  (5F15.7). 
(fl0.2) 

YOUR  FORMAT  IS: 

FORMAT (F10. 2) 

IS  THIS  CORRECT? 

y 

YOUR  DATA  IS  NOw  TRANSFORMED  INTO  THE  PROPER  FORMAT 
FOR  USE  IN  THE  TIME  SERIES  EDITOR ,  LOCATED  l'>i    FILE 
FT02F001.  YOUR  ORIGINAL  DATA  IS  IN  FILE  FT03F001. 

DO  YOU  WANT  TO  GO  AGAIN? 

n 

CONTROL  RETURNED  TO  CMS 

R; 


Figure  7.   Sample  user  session  with  ZFORMAT  program 
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3 .   Interactive  Keyboard  Input 
a.   Numeric  Input 

When  the  user  is  prompted  at  the  terminal  to 
enter  such  numerical  values  as  the  number  of  AR  parameters, 
estimates  of  parameters  or  the  number  of  differences  to  be 
taken,  he  must  enter  these  values  before  program  execution 
can  continue.   The  user  should  enter  the  data  according  to 
standard  FORTRAN  practice.   For  example,  integer  data  should 
be  entered  (without  a  decimal  point)  for  counts,  such  as 
the  length  of  a  seasonal  period,  and  for  names  beginning 
with  the  letters  I  through  N;  floating-point  data,  such  as 
initial  estimates  of  parameters,  should  be  entered  with  a 
decimal  point.   Because  a  typed  decimal  point  overrides  a 
floating-point  format,  it  is  not  necessary  for  the  user 
to  concern  himself  with  the  format  for  floating-point  input 
data.   However,  care  must  be  taken  when  entering  integer 
data  because  it  must  be  right- justified  in  its  format  field. 
The  user  is  advised  in  each  case  when  the  format  is  other 
than  II.   For  example,  suppose  the  user  desires  to  perform 
analysis  on  a  series  having  only  90  observations.   If  the 
program  that  he  is  executing  requires  the  length  of  the  time 
series,  the  user  will  receive  the  following  request: 

ENTER  LENGTH  OF  THE  TIME  SERIES  VIA  FORMAT  13 

The  user  would  then  enter: 
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column    123 

b90       (where  b  represents  a  blank  space) . 

If  the  blank  were  omitted,  the  program  would  read  the 
series  length  as  900,  and  problems  in  execution  would 
occur. 

b.   Alphabetic  Input 

The  Editor  often  asks  the  user  to  respond  with 
alphabetic  input.   Generally,  this  is  in  the  form  of  the 
response  to  a  question  requiring  a  yes  or  no  answer,  or  a 
response  to  the  question  of  which  program  to  execute.   The 
editor  has  been  programmed  to  read  only  the  first  letter 
of  such  responses.   Therefore,  the  user  need  only  enter  the 
first  letter  of  the  response  for  each  such  inquiry.   For 
example,  the  user  should  enter  Y  for  yes,  N  for  no,  P  for 
the  PLOT  option,  X  for  the  XSUMSQ  option,  W  for  the 
WMARQRDT  option,  etc.   The  other  alphabetic  input  is 
generally  entry  of  titles  to  plots;  these  can  be  any 
combination  of  numeric  and  alphabetic  characters,  as  long 
as  they  do  not  exceed  72  columns  in  length.   For  example,  a 
suitable  title  would  be: 

PLOT  OF  AUTOS  AND  PAUTOS  FOR  SERIES  C  DATA  (2  ORDINARY  DIFFERENCES) 

4.   Output 

Most  of  the  results  are  written  out  at  the  user's 
terminal.   However,  in  some  cases  the  output  is  printed 
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offline  to  conserve  time.   Such  results  as  plots  and 
transformed  time  series  are  written  onto  various  files 
(FT03F001,  FT09F001,  FT08F001) ,  and  the  TIMESER  EXEC  pro- 
gram causes  them  to  be  automatically  printed  offline  under 
the  user's  identification  number  (USERID) .   The  plots  and 
files  can  also  be  printed  out  at  the  terminal  using  the 
usual  CMS  commands  in  the  CMS  mode,  outside  the  Editor,  or 
in  the  CMSWORK  program  (see  next  section) .   However,  the 
user  should  be  aware  that  plotting  graphs  at  the  terminal 
is  generally  quite  a  slow  process. 
5.   CMSWORK  Program 

This  program  permits  the  user  to  enter  the  CMS 
environment  to  perform  routine  CMS  functions  without  leaving 
the  Time  Series  Editor.   Commonly  used  CMS  commands  include 
file  name  alteration,  file  erasure,  file  offline  printing 
or  punching,  obtaining  a  disc  status,  and  listing  all  disc- 
resident files.   However,  essentially  all  CMS  commands  can 
be  issued  while  in  CMSWORK.   Figure  8  provides  an  example 
of  the  use  of  the  CMSWORK  program. 

C.   TRANS  PROGRAM 

The  TRANS  program  takes  a  given  time  series  in  File 
F102F001  and  performs  a  transformation  upon  each  data  ele- 
ment.  The  options  include  a  change  of  scale,  a  power  trans- 
formation, a  shift  of  the  origin,  and  a  natural  logarithm 
transformation.   The  original  data  is  written  onto  a  file 
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timeser    s 

ENTER    LETTER    FOR    OPTION    YOU    i\ANT. 

C 

ENTER  DESIRED  CP/CMS  COMMANDS,  ONE  PER  LINE. 

WHEN  FINISHED  TYPE:  &GOTO  -QUES 

Stat 

P  (191):  30  FILES;  263  REC  IN  USE,  33  LEFT  (of  296),  39%  FULL  (2  CYL) 

listf  *  ft02f002 

FILE  NOT  FOUND 

17.14.13  LISTF  *  FT02F002 

!  !  !  E(00002)  !  !  ! 
listf  *  ft02f001 
FILENAME 
SERG 
SERC 
LNSERG 
FILE 
cp  q  f 

FILES:-  NO  RDR,  NO  PRT,  NO  PUN 
erase  file  ft08f001 
offline  print  file  ft02f001 
offline  print  serg  ft02f001 
offline  print  sere  ft02f001 
erase  file  ft02f001 
stat 

P  (191):  28  FILES;  240  REC  IN  USE,  56  LEFT  (of  296),  81%  FULL  (2  CYL) 
&goto  -ques 

DO  YOU  WANT  TO  GO  AGAIN? 
n 

CONTROL  RETURNED  TO  CMS 
R; 


FILETYPE 

MODE 

NO. 

REC. 

DATE 

FT0  2F0  01 

PI 

3 

9/16 

FT02F001 

PI 

r> 

9/16 

FT02F001 

PI 

3 

9/16 

FT0  2F0  01 

PI 

3 

9/16 

Figure  8.   Sample  user  session  with  CMSWORK  program 
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called  DATA  FT02F001,  while  the  transformed  series  is 
written  onto  FILE  FT02F001.   The  parameters  of  the  trans- 
form itself  are  written  onto  FILE  FT07F001.   The  TRANS 
program  is  self-contained,  using  no  other  programs. 

D.   DIFF  PROGRAM 

The  DIFF  program  takes  a  given  time  series  in  FILE 
FT02F001,  and  performs  non-seasonal  and/or  seasonal  differ- 
encing operations  on  the  series  in  order  to  help  achieve 
stationarity  for  proper  modeling.   The  user  must  indicate 
if  seasonal  differences  are  required;  if  so,  the  length  of 
the  season  is  input.   The  user  is  then  required  to  enter 
the  number  of  seasonal  and  nonseasonal  differences.   After 
execution  of  DIFF,  the  original  data  are  in  FILE  FT02F001, 
and  the  differenced  data  are  written  onto  FILE  FT03F001. 
To  use  the  differenced  data  in  any  other  program,  CMSWORK 
program  must  be  entered  and  the  files  altered  to  save  the 
original  data  (if  desired)  and  to  transfer  the  differenced 
data  to  FILE  FT02F001.   The  CMS  commands  to  perform  this 
shift  of  files  would  look  like: 


ALTER  FILE  FT02F001  Pi  SAVEDATA  FT02F001  Pi 

R; 

ALTER  FILE  FT03F001  Pi  FILE  FT02F001  Pi 

R; 


The  DIFF  program  uses  the  IMSL  subroutine  called  FTRDIF 
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E.  PLOT  PROGRAM 

The  PLOT  program  plots  any  given  time  series  which 
resides  in  FILE  FT02F001.   Other  than  the  time  series, 
which  must  be  on  the  user's  disc  or  entered  offline,  the 
program  requires  only  that  an  identification  title  for  the 
plot  itself  be  entered  during  execution.   The  plot  is  auto- 
matically printed  offline.   The  PLOT  program  uses  a  modified 
PLOTP  subroutine  called  PL0T8  from  the  IBM  Scientific 
Subroutine  Package  Library  (SSPLIB) . 

F.  AUTO  PROGRAM 

The  AUTO  program  takes  a  given  time  series  in  FILE 
FT02F001  and  calculates  summary  statistics  of  utility  in 
Box-Jenkins  modeling.   The  statistics  include  the  sample 
mean,  variance,  autocorrelations  and  partial  autocorrela- 
tions for  lags  one  though  40.   Part  of  those  statistics 
are  printed  out  at  the  user's  terminal,  while  plots  of  the 
autocorrelations  and  partial  autocorrelations  versus  lag 
are  printed  offline.   These  plots  will  also  be  written  onto 
the  user's  disc  in  FILE  FT08F001,  and  may  be  plotted  at 
the  terminal  in  CMS  outside  the  Editor  or  in  the  CMSWORK 
program;  recall  that  this  is  a  time-consuming  process.   The 
AUTO  program  provides  the  user  with  essential  information 
about  stationarity ,  seasonality  and  model  identification. 
With  the  Box-Jenkins  procedures,  the  second  moments  (auto- 
correlations and  partial  autocorrelations)  are  valuable 
tools  in  tentative  model  identification.   Additionally,  AUTO 
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is  useful  in  the  diagnostic  checkout  phase  of  model 
building,  when  examining  the  model  residuals  for  structure. 
The  AUTO  program  uses  the  IMSL  subroutine  FTAUTO. 

G.   ESTIMATE  PROGRAM 

After  the  user  has  tentatively  identified  a  model  for 
a  series  through  analysis  of  the  series  plot,  autocorrela- 
tions and  partial  autocorrelations,  ESTIMATE  should  be 
executed  to  calculate  maximum  likelihood  estimates  of  the 
model  parameters.   ESTIMATE  is  written  to  calculate  parameters 
for  non-seasonal  models  only;  for  seasonal  models,  the 
programs  YESTSEAS  and  WMARQRDT  should  be  used  for  parameter 
estimation.   The  ESTIMATE  program  requires  that  the  series 
to  be  modeled  (already  transformed  and  differenced  to 
achieve  stationarity)  reside  in  FILE  FT02F001;  additionally, 
the  program  will  instruct  the  user  to  input  the  number  of 
MA  and  AR  parameters  in  the  model,  as  well  as  the  number  of 
differences  taken.   The  general  model  for  which  ESTIMATE 
calculates  parameters  is: 


<|>(B)  W!   =   6   +  6  (B)  at 
T      t      o         t 


where  W!  =  V  z|  and  z'  is  the  transformed  value  of  z  . 
ESTIMATE  calculates  estimates  of  the  AR  parameters  for  the 
undif f erenced  form  of  the  model,  the  estimated  MA  parameters 
and  MA  constant  term,  the  residual  variance,  autocorrelations 
and  partial  autocorrelations  of  the  residuals,  plots  of 
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these  autocorrelations  and  partial  autocorrelations,  and 
a  Chi-square  goodness-of-f it  statistic  for  the  model.   The 
original  series  to  be  modeled  remains  in  FILE  FT02F001 
and  the  residuals  of  the  model  are  stored  in  FILE  FT02F001. 
ESTIMATE  uses  the  IMSL  subroutine  FTMAXL  (a  nonlinear 
gradient  search  algorithm)  to  estimate  the  model  parameters, 

H.   YESTSEAS  PROGRAM 

The  YESTSEAS  program  is  used  to  calculate  initial  esti- 
mates of  autoregressive  and  moving  average  parameters  for 
a  generalized  seasonal  Box-Jenkins  model.   These  initial 
estimates  are  used  as  inputs  to  the  program  WMARQRDT,  which 
then  refines  them  to  determine  the  parameter  estimates  that 
minimize  the  sum  of  the  squared  residuals.   The  general 
model  assumed  in  YESTSEAS  is 


cf)(B)  <HBS)VdVgZt   =   e(B)0(BS)at  . 


The  YESTSEAS  program  requires  that  the  seasonal  time  series 
for  which  initial  parameter  estimates  are  required  is  located 
in  FILE  FT02F001;  it  should  be  transformed,  if  desired,  but 
generally  not  differenced,  since  YESTSEAS  performs  the 
required  (seasonal  and/or  non-seasonal)  differencing. 
Terminal  inputs  required  by  the  program  include  the  number 
of  seasonal  and  non-seasonal  differences  to  be  taken  (if 
data  is  already  differenced,  enter  zero  for  these  values) , 
the  length  of  the  seasonal  period  and  the  number  of  each 
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type  of  parameter  to  be  estimated  (that  is,  the  number  of 
each  of  the  seasonal  and  non-seasonal  AR  and  MA  parameters) . 
The  output  of  the  model,  initial  estimates  for  the  requested 
parameters,  is  printed  out  at  the  terminal.   YESTSEAS  uses 
the  IMSL  subroutines  FTRDIF,  FTMAXL,  FTAUTO  and  FTARPS, 
as  well  as  a  modified  version  of  FTMAPS . 

I.   WMARQRDT  PROGRAM 

The  WMARQRDT  program  uses  the  initial  parameter  esti- 
mates calculated  by  YESTSEAS  or  other  means  as  starting  points 
for  calculation  of  parameters  of  a  generalized  seasonal 
Box-Jenkins  model  which  minimize  the  sum  of  the  squared 
residuals.   The  general  seasonal  model  assumed  by  WMARQRDT 
can  be  written: 


cMB)<i>(BS)VdVDz.   =   6   +  6(B)0(BS)a.. 


Details  of  the  Marquardt-type  non-linear  least  squares 
algorithm  employed  in  this  program  are  provided  in  Chapter 
III  of  this  report.   WMARQRDT  requires  that  the  series  to  be 
modeled  reside  in  FILE  FT02F001;  it  should  be  transformed, 
if  desired,  but  generally  not  yet  differenced,  since  the 
program  performs  differencing.   Inputs  at  the  terminal 
include  number  of  seasonal  and  non-seasonal  differences, 
length  of  the  seasonal  period,  number  and  type  of  parameters 
desired,  and  initial  estimates  of  those  parameters.   The 
program  then  calculates  the  least-squares  parameter  estimates, 
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the  standard  error  of  these  estimates,  the  MA  constant  term, 
the  residual  variance,  the  autocorrelations  and  partial 
autocorrelations  of  the  residuals,  the  final  model  sum 
of  squared  residuals  and  a  Chi-square  goodness-of-f it  sta- 
tistic (the  portmanteau  test).   Additionally,  it  plots 
offline  the  autocorrelations  and  partial  autocorrelations  of 
the  residuals.   WMARQRDT  uses  the  IMSL  subroutines  FTRDIF, 
FTAUTO,  LINV1F  and  MDCDFI,  the  SSPLIB  routine  PL0T8 ,  and 
the  Time  Series  Editor  resident  subroutines  PARSH,  MARQRT, 
SUMSQ,  SWAPB  and  FORMB.   The  calculations  are  performed  in 
double-precision  arithmetic. 

J.   XSUMSQ  PROGRAM 

The  XSUMSQ  program  accepts  an  already  transformed  and 
differenced  series  in  FILE  FT02F001  and  general  seasonal 
and  non-seaonal  Box-Jenkins  parameter  values  for  a  general 
seasonal  model  from  the  terminal.   The  program  then  calcu- 
lates the  residual  sum  of  squares  for  these  parameters, 
giving  the  user  a  feel  for  the  "goodness-of-f it"  the 
parameter  estimates  provide  in  modeling  the  given  time 
series.   XSUMSQ  uses  the  Time  Series  Editor  resident  sub- 
program XSUMSQ.  All  output  is  printed  at  the  terminal. 
The  calculations  are  performed  in  double-precision  arithmetic 

K.   FORECAST  PROGRAM 

The  FORECAST  program  uses  the  estimated  Box-Jenkins 
(seasonal  or  non-seasonal)  model  to  compute  forecasts  of 
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the  transformed  and  differenced  time  series.   FORECAST  re- 
quires that  the  time  series  to  be  forecasted  reside  in  FILE 
FT02F001  in  transformed  form.   During  execution  the  input 
required  at  the  terminal  includes  the  forecast  origin,  the 
numbers  and  estimated  values  of  the  AR  and  MA  parameters 
of  the  model,  the  overall  MA  constant,  the  plot  origin 
index,  the  maximum  forecast  lead  time,  the  order  of  differ- 
encing in  the  model,  and  a  level  of  significance  for  the 
forecast  confidence  limits.   The  program  needs  the  transfor- 
mation parameters  from  FILE  FT07F001,  created  when  using 
program  TRANS,  and  performs  the  inverse  transform  to  return 
the  data  to  its  original  form.   FORECAST  also  undiffer- 
ences  differenced  data.   The  program  output  includes  the 
forecasts  up  to  the  given  maximum  lead  time,  the  deviations 
from  each  forecast  for  the  confidence  limits,  and  plots  of 
forecasts  and  confidence  limits  plotted  offline.   The 
FORECAST  program  uses  IMSL  subroutine  FTCAST  and  the  special  IBM 
SSPLIB    subroutine  UTPLT8.   The  plot  itself  and  output  data 
are  written  onto  FILE  FT08F001  on  the  user's  disc;  since 
this  plot  file  takes  considerable  space,  it  is  usually 
best  to  erase  it  after  execution  of  the  program  is  completed 
and  the  plot  itself  has  been  printed  offline. 

L.   ROOTS  PROGRAM 

The  ROOTS  program  is  used  to  determine  the  roots  of 
the  characteristic  equation  for  a  general  ARIMA  model.   The 
roots  are  useful  for  testing  for  stationarity  and  for 
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determining  the  form  of  the  forecast  function.   ROOTS  uses 
the  IMSL  subroutine  ZPOLR  to  calculate  the  roots;  it  requires 
as  input  the  number  of  AR  parameters  in  undif f erenced  form, 
and  the  actual  values  of  these  parameters,  as  determined 
from  the  ESTIMATE  or  WMARQRDT  programs.   The  roots  are 
printed  out  at  the  terminal.   If  desired,  roots  can  also 
be  obtained  for  the  MA  polynomial,  simply  by  substituting 
the  appropriate  MA  values  for  the  AR  values  as  input. 

M.   GENERATE  AND  SIMULATE  PROGRAMS 

Because  of  their  similarities,  the  GENERATE  and  SIMULATE 
programs  are  described  together.   The  GENERATE  program  per- 
mits the  user  to  generate  a  time  series  from  any  non-seasonal 
ARIMA  model  he  specifies.   The  user  must  identify  the  model 
and  give  values  for  the  model  parameters  and  starting  con- 
ditions; a  random  number  seed  must  also  be  input.   The 
program  takes  the  specified  model,  generates  random  noise 
terms,  and  calculates  as  many  values  of  the  time  series  as 
desired.   The  GENERATE  program  can  be  useful  for  purposes 
of  classroom  instruction  in  the  generation  of  a  wide  variety 
of  time  series  examples  for  model  identification  exercises. 


1Suppose  the  model  was  ARIMA (1 , 1 , 0) .   The  differenced  form 

would  be  (l-d>,B)  V1z^  =6   +  a,.   Then,  the  undif  f erenced  form 
rl      t     o     t    2 

would  be  written  (l-d+cf^B  +  cj^B  )  zfc  =  6q  +  afc  ,  where  the 
left-hand  side  was  found  by  multiplying  (l-^B)  by  (1-B)  =  V  . 
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It  could  also  be  useful  in  the  diagnostic  phase  of  model 
checkout;  a  time  series  could  be  generated  from  the  esti- 
mated model,  and  its  properties  compared  with  those  of 
the  original  series.   If  large  discrepancies  occur  in  this 
comparison,  this  may  be  evidence  that  the  model  is  inade- 
quate.  The  model  output,  the  generated  time  series,  is 
written  in  FILE  FT02F001  as  well  as  being  printed  offline. 
The  GENERATE  program  uses  IMSL  subroutine  FTGEN1 . 

The  SIMULATE  program  provides  the  capability  of  gen- 
erating any  number  of  simulated  time  series.   This  program 
is  useful  for  prediction  of  what  might  happen  in  the  future; 
it  also  demonstrates  that  within  a  given  model,  the  time 
series  actually  observed  can  vary  considerably.   This  program 
uses  GENERATE,  but  also  requires  as  input  the  actual  series 
in  FILE  FT02F001   and  the  number  of  simulated  series  the 
user  wishes  to  generate.   The  series  should  be  already 
transformed  and  differenced.   Additionally,  SIMULATE  allows 
the  user  to  select  values  of  the  original  time  series  as 
starting  values  for  the  simulated  series.   The  output  con- 
sists of  the  simulated  series  printed  at  the  terminal.   The 
SIMULATE  program  uses  IMSL  subroutine  FTGENl. 

N.   HELP  OPTION 

The  HELP  option  is  a  modification  to  the  Time  Series 
Editor  CP/CMS  program  itself  that  allows  the  user  to  obtain 


If  desired,  the  user  may  choose  to  input  his  own  starting 
values,  and  not  use  the  actual  time  series  values. 
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information  about  Editor  programs  after  the  initial 
introductory  phase  has  been  completed. 

0 .   SUMMARY 

This  chapter  has  provided  brief  descriptions  of  the 
options  available  for  analysis  of  time  series  data  in  the 
Time  Series  Editor.   The  following  two  chapters  contain 
detailed  examples  of  time  series  analysis  for  both  a  non- 
seasonal  and  a  seasonal  series;  the  accompanying  terminal 
sessions  and  computer  output  for  analysis  of  the  seasonal 
series  is  contained  in  Appendix  B.   Appendix  A  contains  a 
User's  Guide  for  the  Time  Series  Editor,  and  Appendix  C 
contains  listings  of  the  data  sets  used  in  the  analysis  of 
the  next  two  chapters. 
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V.   EXAMPLE  NON-SEASONAL  TIME  SERIES  ANALYSIS 

This  chapter  provides  a  description  of  a  complete  analy- 
sis of  a  non-seasonal  time  series  using  the  Time  Series 
Editor.   The  time  series  analyzed  is  Series  C  (Chemical 
Process  Temperature  Readings),  taken  from  Box  and  Jenkins 
[Ref.  4,  p.  528].   This  time  series  was  selected  since  it 
is  fully  analyzed  and  discussed  in  Reference  4,  so  that  the 
interested  user  can  compare  for  himself  the  results  pre- 
sented there  with  the  results  given  by  the  Time  Series 
Editor.   After  reading  this  overview  of  the  analysis,  the 
reader  can  follow  the  actual  user  session  and  associated 
user  session  Editor  program  output  contained  in  Appendix  B 
to  this  report. 

The  first  step  in  the  analysis  of  series  C  is  to  plot 
the  series  using  program  PLOT.   The  plot  reveals  rather  wide 
fluctuations  in  the  series,  but  not  the  sort  of  explosive 
nonstationary  behavior  that  would  render  an  attempt  to  model 
fruitless.   The  plot  also  reveals  that  the  time  series  has 
a  large  amount  of  momentum  (movements  of  the  series  tend  to 
resist  changes  of  direction  over  time) .   This  is  character- 
istic of  ARIMA  models  with  two  or  more  differences. 

As  a  second  step,  the  autocorrelations  (autos)  and 
partial  autocorrelations  (pautos) ,  mean,  and  variance  of 
the  series  were  estimated  using  AUTO.   The  plot  shows  that 
the  autos  dampen  out  slowly  in  a  nearly  linear  fashion. 
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This  is  an  indication  that  the  process  is  nonstationary 
and  that  one  or  more  differences  are  required  to  make  it 
stationary.   The  pauto  plot  is  not  informative  when  the 
autos  fail  to  dampen  out  rapidly. 

As  suggested  by  the  plots  of  the  original  series  and 
its  auto  and  pautos,  the  program  DIFF  was  used  to  examine 

the  series  with  both  one  and  two  non-seasonal  differences; 

1  2 

i.e.,  the  series  z'  =  V  z   and  z"  =  V  z   were  derived. 

The  plots  suggest  that  two  differences  might  be  required  to 

achieve  stationarity  in  the  series.   However,  one  might  be 

able  to  get  by  with  a  single  difference  and  an  AR  parameter 

near  unity,  since  the  autos  of  z'  dampen  out  slowly.   Thus, 

two  possible  model  candidates  are  suggested: 

1.   ARIMA(1,1,0)  :   (1  -  cJ^B)  V"^   =   9q  +  afc  , 


and 


2  2 

2.   ARIMA(0,2,2)  :   V  z    =   6Q  +  (1  -  9^  -  0^  )  afc 


For  purposes  of  estimation,  the  second  model  was  extended 

to  two  moving  average  parameters.   Such  overfitting  is  often 

done  to  see  if  the  estimated  moving  average  parameters  turn 

out  to  be  near  zero,  thus  confirming  the  tentative  identification 

The  next  step  in  the  analysis  process  is  to  calculate 
the  maximum  likelihood  estimates  of  the  model  parameters. 
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The  program  ESTIMATE  was  used  to  do  this.   The  estimated 
parameters  for  the  ARIMA (1,1,0)  model  were: 

4>1   =   0.8073 

0    =  -0.006789 

a2      =   0.0177633 
a 

The  autos  and  pautos  of  the  residuals  were  calculated 

to  test  the  model.   The  correlations  should  appear  to  be 

estimates  of  a  pure  white  noise  process  if  the  model  is 

adequate;  the  (1,1,0)  model  seemed  to  pass  that  test.   The 

2 
chi-square  goodness-of-f it  test  results  in  a  x   =28.88  with 

24  df  and  a  signficance  level  of  0.2247.   Thus,  there  is 

no  strong  evidence  to  suggest  that  the  (1,1,0)  model  is 

inadequate.   The  model  can  be  written,  in  undif ferenced 

form: 

(1  -  1.8073B  +  0.8073B2)zt   =   a   . 

The  0   is  omitted  here  since  it  is  nearly  zero  in  value, 
o  J 

The  estimated  parameters  for  the  (0,2,2)  model  were 

Q1      =   0.1378 

62   =   0.1296 

6    =  -0.0026787 
o 

a2   =   0.0189559 
a 

As  before,  the  correlation  plots  of  the  residuals  fail  to 

suggest  any  inadequacy  of  the  model.   However,  the  chi-square 

2 
goodness-of-f it  test  for  this  model  yielded  ax   =36.75 

with  23  df  and  a  significance  level  of  0.0346.   Therefore, 
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if  the  ARIMA (0,2, 2)  model  were  a  "correct"  one,  a  chi-square 
value  as  large  as  36.75  would  occur  by  chance  with  a  proba- 
bility of  only  0.0346.   Due  to  its  simplicity  (parsimony 
is  a  desirable  feature  in  time  series  models)  and  better 
fit,  the  ARIMA(1,1,0)  model  was  chosen  as  the  "best"  of 
the  two  alternatives  originally  selected. 

The  ARIMA (1,1,0)  model  calculated  was  then  used  to  make 
forecasts  and  confidence  limits  for  these  forecasts,  using 
program  FORECAST.   The  forecasts  were  made  for  25  periods 
into  the  future,  with  plot  origin  200  and  forecast  origin 
220.   The  length  of  the  series  C  itself  is  226;  with  one 
difference,   it  becomes  225.   The  plot  in  Appendix  B  shows 
the  forecasted  values,  along  with  the  confidence  limits  at 
level  of  significance  0.10;  the  plot  shows  that  the  width 
of  the  confidence  limits  increases  substantially  as  the  lag 
gets  large. 

Finally  the  program  ROOTS  was  used  to  calculate  the 
roots  of  the  characteristic  equation  for  the  ARIMA (1,1,0) 
model,  which  can  be  written: 

1  -  1.8073B  -  0.8073B2   =   0 

The  roots  calculated  by  ROOTS  were  1.239  and  1.0.   Also, 
the  program  SIMULATE  was  used  to  generate  a  simulated  series 
from  the  ARIMA (1,1,0)  model,  using  the  last  two  values  of 
the  actual  series  as  starting  values.   The  entire  session 
lasted  about  two  hours,  including  checkout  of  plots  and 
consumed  less  than  a  minute  of  CPU  time. 


VI.   EXAMPLE  SEASONAL  TIME  SERIES  ANALYSIS 

This  chapter  provides  a  description  of  a  complete  analy- 
sis of  a  seasonal  time  series  using  the  Box-Jenkins  tech- 
nique through  the  Time  Series  Editor.   The  time  series 
analyzed  is  Series  G  (International  Airline  Passengers: 
Monthly  Totals  (Thousands  of  Passengers)  January  1949  - 
December  I960),  taken  from  Box  and  Jenkins  [Ref.  4,  p.  531]. 
This  time  series  was  selected  since  it  was  fully  analyzed 
and  discussed  in  Chapter  9  of  Reference  4;  again,  the 
interested  reader  can  compare  for  himself  the  results  pre- 
sented by  Box  and  Jenkins  with  those  given  by  the  Time 
Series  Editor  programs.   After  reading  this  overview  of  the 
analysis,  the  reader  can  follow  the  actual  user  session  and 
associated  Editor  program  output  contained  in  Appendix  C 
to  this  report. 

The  plot  shows  both  annual  seasonality  and  an  increasing 
trend.   This  suggests  that  a  seasonal  model  with  differencing 
may  be  needed.   The  autocorrelations  (autos)  and  partial 
autocorrelations  (pautos)  were  then  calculated  and  plotted 
using  AUTO.   The  plot  of  the  autos  shows  very  slow  damping 
out  with  peaks  at  intervals  of  12,  indicating  strong  non- 
stationarity  and  a  seasonal  period  of  12  months.   Again, 
here  the  pauto  plot  is  not  informative,  due  to  the  slow 
damping  out  of  the  autos.   As  it  is  sometimes  useful  in 
dealing  with  seasonal  models,  a  natural  log  transform  was 
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made  on  the  series  G  data  using  program  TRANS.   The  plot 
of  the  logged  data  shows  little  change  in  non-stationarity , 
and  the  autos  and  pautos  of  the  logged  data  still  indicate 
seasonality  and  non-stationarity. 

Next,  differencing  to  achieve  stationarity  was  tried, 
using  program  DIFF;  both  one  seasonal  and  one  non-seasonal 
difference  of  the  logged  data  was  taken.   The  autos  and 
pautos  of  the  data  V  V    (In  z  )  appear  much  improved, 
rapidly  damping  out.   They  also  exhibit  sharp  peaks  at  the 
periods  of  seasonality,  indicating  the  need  for  seasonal 
parameterization  in  the  model.   Since  positive  identification 
of  the  model  type  from  the  auto  and  pauto  plots  was  not 
possible,  two  were  postulated  as  close  candidates: 


12 
1.   ARIMA  (0,1,1)  x  (0,1,1)    ,  written 


V1V]12(ln  zt)  =  eQ  +  (1-61B)  (l-0ia2Bl2)at  , 


and 


12 

2.   ARIMA  (1,1,1)  x  (0,1,1)    ,  written 


(l-(J)1B)V1V112(ln  zt)  =  GQ  +  (l-eiB)  (l-G1^12B12)at 


The  next  step  in  the  analysis  was  to  calculate  the 
parameter  estimates  for  both  models.   YESTSEAS  was  used  to 
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obtain  initial  parameter  estimates.   For  the  model 

ARIMA  (0,1,1)  x  (0,1, l)12,  YESTSEAS  yielded  starting  values 


,  ,  ,   =   0.390425 
1  (s) 


0,  10,  ,   =   0.534397 
1/12  (s) 


For  this  model,  calculation  of  final  parameter  estimates 
in  WMARQRDT  using  the  starting  values  above  yielded  the 
following  in  seven  iterations: 


=   0.377152 


0    2   =   0.572387 


)    =   0.000291  ; 
o 


the  chi-square  statistic  for  residual  lack  of  fit  of  the 

2 
model  was  x   =  29.713571,  with  df  =  38  and  a  probability 

2 
of  exceeding  the  x   value  of  .829. 

For  the  ARIMA  (1,1,1)  x  (0,1,1)  12  model  YESTSEAS  calcu- 
lated starting  values: 


d>.  ,  .   =   0.112699 
Yl(s) 


6  (s)   =   0.490883 
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e 


1,12(S)   =   0.533679  ; 


for  this  model,  WMARQRDT  yielded  the  following  parameter 
values  in  ten  iterations: 

Jx   =   0.146667 


x   =   0.509816 


°1  12   =   0.573388 


The  chi-square  statistic  for  residual  lack  of  fit  of  the 

2 
model  was  x   =  28.302543,  with  df  =  37  and  a  probability 

2 
of  exceeding  the  x   value  of  .847. 

Next,  the  plots  of  autos  and  pautos  of  the  residual  for 
both  models  were  examined;  both  models  have  autos  and  pautos 
that  dampen  out  rapidly,  and  essentially  appear  to  be 
"white  noise",  with  the  exception  of  a  small  peak  at  auto 
and  pauto  of  lag  12,  corresponding  to  the  seasonal  period. 
The  chi-square  statistics  indicate  that  both  models  have 
"about"  the  same  goodness  of  fit  to  the  data.   Consequently, 
both  models  were  used  to  make  forecasts  of  the  series. 

Program  FORECAST  was  used  to  forecast  series  G  into  the 
future  for  30  time  periods,  with  a  forecast  origin  of  131; 
the  plot  origin  selected  was  index  100.   As  expected,  both 
models  do  about  the  same  job  of  forecasting  the  series. 


91 


The  significance  level  for  the  confidence  limits  for  both 
plots  was  90%. 

As  a  final  check  of  both  models,  the  program  XSUMSQ 
was  used  to  calculate  the  sum  of  squared  residuals  for 
models.   The  results  were  as  follows: 


1.   For  ARIMA  (0,1,1)  x  (0,1, l)12  , 


s2(e  ,  e,,  6,  ,0,  oh     =     0.181929 

o    ±         ± ,  ±  z.        a 


2.   For  ARIMA  (1 , 1, 1)  x  (0, 1 , 1) 12  , 


S2((L,  6  ,6,,0,  -.o'CJ2)   =   0.181643 
Yl    o   1   1,12   a 


It  can  be  seen  here  that  both  models  are  nearly  equally 
"good",  and  either  could  be  used  with  a  reasonable  amount 
of  confidence  for  forecasting  series  G. 
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VII.   SUMMARY 

There  has  been  an  increasing  need  in  military  applica- 
tions, as  well  as  in  the  general  business  area,  for  a 
computer-aided  time  series  analysis  and  forecasting  capability 
that  is  both  powerful  and  easy  to  use.   Current  military- 
associated  functions  in  which  time  series  techniques  are 
valuable  include  material  inventory  management,  recruiting, 
personnel  management,  budget  analysis,  force  level  projections, 
and  perhaps  even  short-term  weather  prediction. 

The  Time  Series  Editor  that  has  been  described  in  this 
report  provides  a  unified  collection  of  programs  that  greatly 
facilitate  the  conduct  of  a  complete  time  series  analysis 
and  forecasting  evolution  using  Box- Jenkins  methodology. 
The  routines  guide  the  user  from  the  data  input  stage, 
through  the  data  analysis  and  parameter  estimation  stages, 
and  finally  through  the  model  building,  diagnostic  checking 
and  forecasting  stages.   With  its  simple  input  requirements, 
the  Editor  can  be  quickly  mastered  by  even  a  beginning 
computer  user,  who  has  a  basic  understanding  of  Box- Jenkins 
methodology. 

The  Box-Jenkins  methodology  has  been  described  broadly 
in  Chapter  II  and  descriptions  of  the  programs  resident 
in  the  Time  Series  Editor  have  been  given  in  Chapter  IV. 
Example  analyses  of  both  non-seasonal  and  seasonal  time 
series  are  provided  in  Chapters  V  and  VI,  with  complete 
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user  sessions  and  output  packages  for  these  analyses 
included  as  Appendices  B  and  C.   The  Appendices  also  con- 
tain a  Time  Series  Editor  User's  Guide,  as  well  as  complete 
program  listings. 

Although  the  Time  Series  Editor  in  its  present  form 
provides  an  excellent  capability  for  interactive  time 
series  analysis  using  the  Box- Jenkins  methodology,  there 
are  additions  to  the  program  set  that  might  be  made  in  the 
future  which  would  improve  the  Editor's  capability  and 
utility.   It  is  first  recommended  that  the  model  diagnostic 
testing  capability  be  extended  to  include  a  periodogram 
analysis,  and/or  other  tests  related  to  the  spectral  analy- 
sis of  time  series  [see  Ref.  4,  p.  294].   Another  useful 
addition  might  be  to  include  in  the  Time  Series  Editor  a 
package  capable  of  improving  the  ease  of  entering  data 
and  simplifying  the  input  error  correction  problem. 
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APPENDIX  A 
USER'S  GUIDE  TO  THE  TIME  SERIES  EDITOR 

The  Time  Series  Editor  is  a  collection  of  FORTRAN 
programs  driven  by  a  control  program  called  TIMESER  EXEC 
in  the  CP/CMS  executive  language  that  has  been  designed 
specifically  for  the  analysis  and  forecasting  of  time 
series  data  using  the  general  Box-Jenkins  methodology. 
This  Guide  contains  information  essential  for  the  user  to 
access  the  Time  Series  Editor,  enter  time  series  data, 
build  a  model  and  obtain  the  desired  output. 

I.   DATA  INPUT 

The  Time  Series  Editor  requires  that  time  series  data 
be  entered  into  the  sequential  FORTRAN  input/output  file 
named  FILE  FT02F001.   This  can  be  done  either  online  or 
via  cards  read  offline.   The  following  diagram  illustrates 
the  proper  card  deck  arrangement.   When  your  deck  is  ready 
for  input,  give  it  to  a  computer  center  system  operator 
to  direct  it  to  your  disc  space. 

If  the  user  has  a  data  deck  already  punched  up  in  a 
format  other  than  5F15.6,  he  may  enter  the  series  as  above 
into  FILE  FT03F001  (without  the  length  of  series  card)  and 
use  the  Editor  program  ZFORMAT  to  transform  it  into  the 
FILE  FT02F001  in  the  proper  format,  without  destroying  his 
original  file.   This  program  is  described  in  the  next  section 
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II.   TABLE  OF  OPTIONS 

This  Table  provides  the  user  with  the  basic  information 
necessary  to  understand  the  data  requirements,  functions 
and  output  options  for  each  program  in  the  Editor. 
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III.   THE  BASIC  USER  SESSION 

To  use  the  Time  Series  Editor,  the  user  must  log  into 
CMS,  get  into  CP,  link  to  the  disc  storage  area  where  the 
Time  Series  Editor  resides,  reimplement  CMS,  log  into  the 
general  user  and  Time  Series  Editor  disc  areas,  and  enter 
the  TIMESER  routine.   This  section  will  provide  explicit 
guidelines  to  enable  the  user  to  perform  the  above  steps 
on  the  NPS  CP/CMS  system.   Commands  marked  with  an  asterisk 
(*)  are  those  actually  entered  on  the  terminal  by  the  user 
(the  asterisk  itself  is  omitted) .   Those  without  an  aster- 
isk and  those  written  in  all  capital  letters  are  system 
responses  at  the  terminal.   Numbered  sentences  are  comments, 
which  will  not  appear  during  an  actual  user  session.   The 
instructions  and  system  responses  assure  the  user  is  on  an 
IBM  2741  Input/Output  Terminal.   Some  minor  modifications 
may  be  necessary  if  other  terminals  are  used. 


1.  Turn  the  terminal  on,  depress  the  BREAK  key,  and  wait 
for  the  system  to  respond: 

CP-67  online  xd.65   gsyosu 

2.  Depress  the  ATTN  key.   The  roll  bar  will  advance  and 
the  keyboard  will  unlock.   Then  enter: 

*login  aaaapbb  450k 

3.  aaaa  is  the  user's  identification  number,  and  nn  is  the 
terminal  number  (usually  written  on  the  terminal) . 

For  example,  if  the  user's  ID  number  is  1621  and  the 
terminal  number  is  44,  the  input  would  be: 
login  1621p44  450k.   The  addition  of  450  k  to  the  normal 
login  command  is  necessary  to  execute  the  program 
WMARQRDT  in  the  Editor;  for  users  not  planning  to 
execute  this  program  during  a  session,  this  addition 
is  not  necessary. 
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4.  The  system  will  respond  with  the  statement: 

ENTER  PASSWORD: 
x 

5.  The  user  then  enters  his  password,  or  the  general  users 
password  npg; 

*password 

6.  The  system  will  then  respond: 

ENTER  4-DIGIT  PROJECT  NUMBER  FOLLOWED  BY  4-CHARACTER 
COST  CENTER  CODE: 

7.  The  user  then  enters: 
*gggghhhh 

8.  gggg  is  the  assigned  project  number,  and  hhhh  is  the 
user's  section  designator  or  the  faculty  code. 

9.  The  system  will  respond  with  the  message  of  the  day, 
such  as: 

CP/CMS  HOURS  ...  0930=2  200 (MON-THURS)  ...  0930-1800 (FRI) 
OUTPUT  RETAINED  5  DAYS 
Cms  Version  3.25 

10.  At  this  point,  the  user  is  in  CMS.  He  must  then  get  into 
CP;  this  can  be  done  by  hitting  the  ATTN  key.  The  system 
will  then  respond: 

CP 

11.  The  user  must  then  link  to  the  TIME  SERIES  EDITOR; 
this  is  accomplished  by  entering: 

*link  2069p  191  192 

12.  The  system  will  respond  with: 
ENTER  PASSWORD: 

13.  The  password  (read  only)  to  enter  the  Editor  is: 
*timser 

14.  The  system  then  responds: 
SET  TO  READ  ONLY 
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15.  The  user  now  implements  CMS  by: 
*ipl  cms 

16.  The  system  will  respond: 
CMS  Version  3.25 

17.  Now  the  user  must  log  into  both  the  general  user  and 
the  Time  Series  Editor  area  by  entering: 

*login  191 

18.  The  system  will  respond  with  a  message  such  as: 
R; 

19.  The  user  then  enters  the  command: 
*login  192  t,p 

20.  The  system  will  respond: 

T  (192)  R/O 
R; 

21.  The  user  can  then  enter  the  Time  Series  Editor 
(guided  version)  by  entering  the  command: 

*timeser 

22.  The  system  will  respond: 

EACH  2  SECONDS  EXECUTION  TIME  IS  INDICATED  BY  * 

YOU  HAVE  ENTERED  THE  TIME  SERIES  EDITOR 

PLEASE  RESPOND  TO  EACH  QUERY  WITH  AN  INPUT  AT  THE  TERMINAL 
ENTER  ONLY  THE  FIRST  LETTER  FOR  A  WORD  RESPONSE. 
ENTER  NUMERICAL  VALUES  VIA  FORTRAN  FORMAT.. 

TYPE  INTEGER  VALUES  (RIGHT  JUSTIFIED)  FOR  NAMES  STARTING 
WITH  I  THROUGH  N.  TYPE  FLOATING  VALUES  WITH  DECIMAL  FOR 
ALL  OTHERS. 

DO  YOU  WANT  A  LIST  OF  THE  OPTIONS? 

23.  The  user  is  then  on  his  own,  guided  by  the  Exec  routine. 
See  the  notes  that  appear  at  the  end  of  this  guide  for 
additional  information.   Eventually  the  user  will  be 
asked: 

DO  YOU  WANT  TO  TRY  AGAIN? 
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24.  If  a  yes  response  is  given,  another  sequence  will  begin; 
if  the  response  is  no,  the  user  will  be  taken  out  of 
the  Time  Series  Editor  environment  and  returned  to  CMS. 
The  system  response  will  be: 

CONTROL  RETURNED  TO  CMS 

R; 

25.  The  user  can  then  log  out  of  CMS  by  typing: 
*cp  logout 

26.  The  system  will  respond  with: 

CONNECT=  00:08:02   VIRTCPU=  000:07.98   TOTCPU=  000.10.94 
LOGOUT  AT  14.22.04  on  10/16/78 

27.  The  user  should  then  turn  off  his  terminal  and  tear  off 
the  output  from  his  session. 


The  more  experienced  user  can  dispense  with  the 
"welcome  aboard"  section  of  the  Time  Series  Editor  and  get 
right  down  to  business  by  using  the  shortened  version  of  the 
Editor.   This  shortened  version  may  be  entered  by  linking  in 
the  normal  way,  and  then  entering  the  Editor  by  typing  the 
COMMAND 

*timeser  s        (asterisk  omitted) . 


The  system  will  immediately  respond: 


ENTER  LETTER  FOR  OPTION  YOU  WANT. 


The  session  inside  the  Editor  then  begins 
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IV.   BRIEF  SAMPLE  USER  SESSION 

A  brief  sample  user  session  is  given  below;  it  includes 
copies  of  the  offline  output  generated  during  the  session. 
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repeat  login   nur@pn@ 

login  1621p44  450k 
ENTER  PASSWORD: 

ENTER  4-DIGIT,  PROJECT  NUMBER  FOLLOWED  BY  4-CHARACTER  COST  CENTER  CODE: 

0444rl72 

READY  AT  17.24.38  ON  09/16/78 

CMS  Version  3.25 

stat 

P  (191):  29  FILES;  241  REC  IN  USE,  55  LEFT  (of  296),  8.1%  FULL  (2  CYL) 

R; 

cp  q  f 

FILES:-  NO  RDR,  NO  PRT,  NO  PUN 

R; 

CP 

link  2069p  191  192 

ENTER  PASSWORD: 

SET  TO  READ  ONLY 

ipl  cms 

CMS  Version  3.25 

login  191 

R; 

login  192  t,p 

T  (192)  R/O 

R; 

timeser 

EACH  2  SECONDS  EXECUTION  TIME  IS  INDICATED  BY  *. 

YOU  HAVE  ENTERED  THE  TIME  SERIES  EDITOR. 

PLEASE  RESPOND  TO  EACH  QUERY  WITH  AN  INPUT  AT  THE  TERMINAL. 
ENTER  ONLY  THE  FIRST  LETTER  FOR  A  WORD  RESPONSE. 
ENTER  NUMERICAL  VALUES  VIA  FORTRAN  FORMAT. 

TYPE  INTEGER  VALUES  (RIGHT  JUSTIFIED)  FOR  NAMES  STARTING 

WITH  I  THRU  N.  TYPE  FLOATING  VALUES  WITH  DECIMAL  FOR  ALL  OTHERS. 

DO  YOU  WANT  A  LIST  OF  THE  OPTIONS? 

y 

OPTION  DESCRIPTION 

GENERATE  GENERATE  ANY  ARIMA  TIME  SERIES 

AUTO  CALCULATE  AUTOCORRELATIONS,  PAUTOS,  MEAN  AND  VARIANCE 

PLOT PLOT  A  TIME  SERIES 

ESTIMATE  CALCULATE  MAX  LIKELIHOOD  ESTIMATES  OF  ARMA  PARAMETERS 

DIFF DIFFERENCE  A  TIME  SERIES 

FORECAST  FORECAST  FUTURE  VALUES,  CONSTRUCT  CONFIDENCE  INTERVALS 

TRANS -^TRANSFORMS  VALUES  OF  A  TIME  SERIES 

ROOTS  DETERMINES  ROOTS  OF  ARIMA  CHARACTERISTIC  EQUATION 

ZFORMAT  ALTER  DATA  FILE  TO  FORMAT  5F15.6 

CMSWORK  PERFORM  CP/CMS  COMMANDS  IN  TIMESER  EXEC 

SIMULATE  SIMULATE  NONSEASONAL  TIME  SERIES 

YESTSEAS  CALCULATE  INITIAL  SEASONAL  PARAMETERS 

aMARQRDT  MARQUARDT  SOLUTION  FOR  PARAMETER  ESTIMATES 

XSUMSQ  CALCULATE  SUM  OF  SQUARES  FOR  ARBITRARY  PARAMETERS 


aOULD  YOU  LIKE  MORE  INFO? 

y 
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ENTER  OPTION  YOU  WANT  INFO  ABOUT. 


AUTO  THIS  PROGRAM  CALCULATES  AUTOCORRELATIONS,  PARTIAL 

AUTOCORRELATIONS,  THE  MEAN  AND  THE  VARIANCE  FOR  A  GIVEN  TIKE  SERIES 
aHICH  MUST  RESIDE  IN  FILE  FT02F001.   THE  PROGRAM  USES 
FTAUTO  IN  THE  IMSL  LIBRARY.   THE  AUTOCORRELATIONS  AND  PAUTOS  CAN  BE 
PLOTTED  OFFLINE. 


DO  YOU  WANT  INFO  ABOUT  ANOTHER  OPTION? 

n 

DO  YOU  WANT  TO  TRY  A  SESSION? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

c 

ENTER  DESIRED  CP/CMS  COMMANDS,  ONE  PER  LINE. 

WHEN  FINISHED  TYPE:  &GOTO  -QUES 

listf  *  ft02f001 

FILENAME  FILETYPE  MODE  NO.REC.  DATE 

SERG      FT02F001   PI       3     9/16 

SERC      FT02F001   Pi       5     9/16 

LNSERG    FT02F001   PI       3     9/16 

FILE      FT02F001   PI       1     9/16 

erase  file  ft02f001 

alter  sere  ft02f001  pi  file  ft02f001  pi 

stat 

P  (191):  28  FILES;  240  REC  IN  USE,  56  LEFT  (of  296),  81%  FULL  (2  CYL) 

&goto  -ques 

DO  YOU  WANT  TO  GO  AGAIN? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

a 

IS  YOUR  DATA  IN  FILE  FT02F001? 

y 

EXECUTION  BEGINS. . . 

AUTOCORRELATIONS 


0.978      0.944 

0.468      0.413 

-0.052    -0.101 


0.902 

0.854 

0.802 

0.748 

0.692 

0.635 

0.579 

0.923 

0.359 

0.305 

0.253 

0.201 

0.150 

0.098 

0.047 

-0.003 

0.151 

-0.200 

-0.248 

PARTIAL  AUTOCORRELATIONS 


0.978  -0.260  -0.157  -0.093  -0.058  -0.045 
-0.036  -0.041  -0.038  -0.024  -0.037  -0.027 
-0.034  -0.061  -0.079  -0.048  -0.037 


•0.012  -0.038  -0.022  -0.010 
•0.032  -0.070  -0.048  -0.024 


MEAN=  22.9739 


VARIANCE  =   4.22273 


ENTER  TITLE  FOR  PLOTS. 

autos  and  pautos  for  series  c  data 
YOUR  AUTO  AND  PAUTO  PLOTS  HAVE  BEEN  PRINTED  OFFLINE, 
PICK  UP  IN  ROOM  1140  UNDER  YOUR  USER  ID  NUMBER. 

DO  YOU  WANT  TO  GO  AGAIN? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

C 

ENTER  DESIRED  CP/CMS  COMMANDS,  ONE  PER  LINE. 

WHEN  FINISHED  TYPE:  &GOTO  -QUES 

offline  print  file  ft02f001 

alter  file  ft02f001  pi  sere  ft02f001  pi 

igoto  -ques 

DO  YOU  WANT  TO  GO  AGAIN? 

n 

CONTROL    RETURNED   TO    CMS 

R; 
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V.   PROBLEM  CONTROL  NOTES 

This  section  will  cover  corrective  measures  that  can  be 
taken  when  things  fail  to  go  as  expected  while  in  the 
TIMESER  environment. 

a.  A  typing  error  in  the  CMS  environment  can  be 
corrected  by  typing  the  @  character  as  many  times  as  is 
required  to  back  up   and  then  type  the  correct  values.   For 
example,  if  the  user  typed  timesre,  the  user  could  correct 
the  mistake  by  typing  two  @  signs,  followed  by  the  correct 
spelling  er,  as  follows:   timesre@@re.   An  entire  line  can 

be  deleted  by  typing  the  C  character  (or  [    on  some  terminals) 

b.  When  working  with  TIMESER  executive  programs,  the 
user  should  exercise  care  before  hitting  the  return  key  (or 
control s  on  some  terminals) .   If  an  input  value  is  required 
and  the  return  key  is  hit  before  the  proper  response  is 
entered,  the  user  will  be  likely  to  get  thrown  out  of  the 
editor  and  have  to  begin  again.   In  most  cases,  errors  can 
be  corrected  only  before  the  return  key  is  struck  (in  some 
programs  you  get  a  second  chance  for  input) . 

c.  Particular  care  should  be  taken  for  integer  value 
input,  which  must  be  right  justified  in  the  format  field. 
The  editor  will  advise  the  user  in  all  cases  where  the 
integer  format  is  other  than  II. 

d.  If  for  any  reason  the  user  finds  himself  in  a  debug 
or  error  condition  (caused  by  erroneous  data,  or  a  "blowup" 
in  one  of  the  non-linear  optimization  routines  usually 
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caused  by  very  poor  initial  input  values) ,  the  following 
procedure  will  get  the  user  back  into  the  normal  TIMESER 
environment: 

(1)  depress  the  ATTN  key  twice;  this  gets 
the  user  into  CP;  hit  the  ATTN  key  again, 
and  then  type  kx  to  kill  the  execution. 

(2)  re-ipl  CMS,  and  login  191  and  then  login 
192  t,p. 

(3)  then  the  user  can  type  TIMESER  or  TIMESER  S, 
and  return  to  the  TIMESER  environment 

On  the  next  page  is  a  sample  user  session  where  an  error 

causing  a  debug  condition  has  occurred. 

Here  the  user  executed  a  program  that  required  data 

in  FILE  FT02F001,  and  the  FILE  did  not  exist.   As  the 

example  shows,  recovery  is  quick.   Simply  hit  the  break 

button  to  get  into  CP,  login  191,  login  192  t,p,  and  then 

type  timeser  s  to  return  immedia  ely  to  the  Editor  environment 
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APPENDIX  B 

KEYBOARD  SESSION  AND  OU'  NALYSIS  OF 

TIME  SERIES  i 


This  appendix  contains  the  com]       erminal  keyboard 
session  and  all  offline  output  from  the  analysis  of  Box 
and  Jenkins'  [Ref  .  4]  time  series  G     ternational  airline 
passengers,  monthly  totals,  Jan  1949  -  Dec  1960)  using  the 
Time  Series  Editor.   This  appendix  i   Intended  to  supplement 
the  discussion  of  the  analysis  of  s       G  given  in  Chapter 
VI  of  this  report. 

The  terminal  listings  are  presented  first,  followed  by 
the  computer  offline  output. 


repeat  login   nur@pn@ 

login  1621p44  400k 
ENTER  PASSWORD: 

ENTER  4-DIGIT  PROJECT  NUMBER  FOLLOWED  BY  4-CHARACTER  COST  CENTER  CODE: 

0444rl72 

READY  AT  15.12.34  ON  09/16/78 

CMS  Version  $.25 

CP 

link  2069p  191  192 

ENTER  PASSWORD: 

SET  TO  READ  ONLY 

ipl  cms 

CMS  Version  3.25 

login  191 

R;  .     -~-  4 

login  192  t,p  .  ,^L'M/P  ■ 

T  (192)  R/O 
R; 

timeser 

EACH  2  SECONDS  EXECUTION  TIME  IS  INDICATED  BY  *. 

YOU  HAVE  ENTERED  THE  TIME  SERIES  EDITOR.        i- 

PLEASE  RESPOND  TO  EfiC^  QUERY  WITH  AN  INPUT  AT  THE  TERMINAL. 
ENTER  ONLY  THE  FIRST  LETTER  FOR  A  WORD  RESPONSE. 
ENTER  NUMERICAL  VALUES  VIA  FORTRAN  FORMAT. 

TYPE  INTEGER  VALUES  (RIGHT  JUSTIFIED)  FOR  NAMES  STARTING 

WITH  I  THRU  N.  TYPE  FLOATING  VALUES  WITH  DECIMAL  FOR  ALL  OTHERS. 

DO  YOU  WANT  A  LIST  OF  TH£  OPTIONS? 

y 

OPTION  DESCRIPTION 

GENERATE GENERATE  ANY  ARIMA  TIME.  (SERIES 

AUTO  CALCULATE  AUTOCORRELATIONS,  PAUTOS ,  MEAN  AND  VARIANCE 

PLOT PLOT  A  TIME  SERIES 

ESTIMATE  CALCULATE  MAX  LIKELIHOOD  ESTIMATES  OF  ARMA  PARAMETERS 

DIFF DIFFERENCE  A  TIME  SERIES 

FORECAST FORECAST  FUTURE  VALUES,  "CONSTRUCT  CONFIDENCE  INTERVALS 

TRANS  7-TRANSFORMS  VALUES  OF  A  TIME  SERIES 

ROOTS  --DETERMINES  ROOTS  OF  ARIMA  CHARACTERISTIC  EQUATION 

ZFORMAT ALTER  DATA  FILE  TO  FORMAT  5F15."6 

CMSfcORK  PERFORM  CP/CMS  COMMANDS  IN  TIMESER  EXEC 

SIMULATE  SIMULATE  NONSEASONAL  TIME  SERIES 

YESTSEAS  CALCULATE  INITIAL  SEASONAL  PARAMETERS 

WMARQRDT  MARQUARDT  SOLUTION  FOR  PARAMETER  ESTIMATES 

XSUMSQ  CALCULATE  SUM  OF  SQUARES  FOR  ARBITRARY  PARAMETERS 

WOULD  YOU  LIKE  MORE  INFO? 

y 

ENTER  OPTION  YOU  WANT  INFO  ABOUT. 

y 

YESTSEAS  THIS  PROGRAM  CALCULATES  INITIAL  PARAMETER  ESTIMATES 

FOR  SEASONAL  AND  NONSEASONAL  ARIMA  MODELS,  TO  BE  USED  AS  INPUTS  TO 
THE  WMARQRDT  PROGRAM. 


DO  YOU  WANT  INFO  ABOUT  ANOTHER  OPTION? 

y 

ENTER  OPTION  YOU  WANT  INFO  ABOUT, 
w 
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aMARQRDT THIS  PROGRAM  CALCULATES  NON-LINEAR  LEAST  SQUARES 

ESTIMATES  OF  BOX-JENKINS  PARAMETERS  FOR  A  GENERAL  (SEASONAL 
OH  NONSEASONAL)  ARIMA  MODEL.  IT  REQUIRES  INITIAL  PARAMETER 
ESTIMATES  AS  STARTING  VALUES;  THESE  MAY  BE  CALCULATED  USING 
PROGRAM  YESTSEAS. 


DO  YOU  WANT  INFO  ABOUT  ANOTHER  OPTION? 

y 

ENTER  OPTION  YOU  WANT  INFO  ABOUT. 
x 

XSUMSQ  THIS  PROGRAM  CALCULATES  THE  SUM  OF  SQUARED  RESIDUALS 

FOR  ANY  SET  OF  ARIMA  (SEASONAL  OR  NONSEASONAL)  PARAMETERS. 

DO  YOU  WANT  INFO  ABOUT  ANOTHER  OPTION? 

n 

*DO  YOU  WANT  TO  TRY  A  SESSION? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

C 

ENTER  DESIRED  CP/CMS  COMMANDS,  ONE  PER  LINE. 

WHEN  FINISHED  TYPE:  S.GOTO  -QUES 

Stat 

P  (191):  26  FILES;  235  REC  IN  USE,  61  LEFT  (of  296),  79%  FULL  (2  CYL) 

cp  q  f 

FILES:-  NO  RDR,  NO  PRT,  NO  PUN 

listf  *  ft02f001 

FILENAME  FILETYPE  MODE  NO. REC.  DATE 

SERG      FT02F001   Pi       3     9/16 

SERC      FT02F001   Pi      • 5  •   9/16 

alter  secg  ft02f001  pi  file  ft02f001  pi 

Sgoto  -ques 

DO  YOU  WANT  TO  GO  AGAIN? 


ENTER  LETTER  FOR  OPTION  YOU  WANT. 

P 

IS  YOUR  DATA  IN  FILE  FT02F001? 

y 

EXECUTION  BEGINS. . . 

ENTER  TITLE  FOR  PLOT 
series  g  data  /  und if f erenced 

TIME  SERIES  PLOTS  HAVE  BEEN  PRINTED  OFFLINE 
DO  YOU  WANT  TO  GO  AGAIN? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

a 

IS  YOUR  DATA  IN  FILE  FT02F001? 

y 

EXECUTION  BEGINS. . . 

AUTOCORRELATIONS 

0.948  0.876  0.807  0.753  0.714  0.682  0.663  0.656  0.671  0.703 
0.743  0.760  0.713  0.646  0.586  0.538  0.500  0.469  0.450  0.442 
0.457      0.482      0.517      0.532      0.494 


PARTIAL  AUTOCORRELATIONS 


0.948  -0.229  0.038 
0.171  -0.135  -0.540 
0.046    -0.100      0.052 


0.094 

0.074 

0.008 

0.126 

0.090 

0.232 

0.166 

0.027 

0.091 

0.025 

0.032 

o.07: 

0.048 

-0.046 

0.048 

-0.163 
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MEAN  =  280.299  VARIANCE  =   14292.0 

ENTER  TITLE  FOR  PLOTS, 
autos  and  pautos  of  series  g  data  /  undif f erenced 

YOUR  AUTO  AND  PAUTO  PLOTS  HAVE  BEEN  PRINTED  OFFLINE. 

PICK  UP  IN  ROOM  1140  UNDER  YOUR  USER  ID  NUMBER. 
DO  YOU  WANT  TO  GO  AGAIN? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

t 

IS  YOUR  DATA  IN  FILE  FT02F001? 

y 

EXECUTION  BEGINS... 

DO  YOU  WANT^TO  TRANSLATE  THE  ORIGIN:  W=Z-SHIFT? 
n 

DO  YOU  WANT  TO  RESCALE  THE  VALUES:  W=Z*SCALE? 
n 

DO  YOU  WANT  A  LOG  TRANSFORMATION? 

y 

TRANSFORMATION  IS  W ( I ) =LOG (SCALE* ( Z ( I ) -SHIFT ) -FACTOR )  WHERE: 

SCALE=  1.00000        SHIFT=0.0  FACTOR-0.0 

YOUR  ORIGINAL  SERIES  IS  IN  DATA  FT02F001  Pi. 
YOUR  TRANSFORMED  SERIES  IS  IN  FILE  FT02F001  PI. 

DO  YOU  WANT  TO  PLOT  THE  TRANSFORMED  VALUES? 

y 

EXECUTION  BEGINS. . . 
*  ENTER  TITLE  FOR  PLOT 

plot  of  series  g  data  /  natural  log  transform 
TIME  SERIES  PLOTS  HAVE  BEEN  PRINTED  OFFLINB 

DO  YOU  WANT  TO  GO  AGAIN? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

a 

IS  YOUR  DATA  IN  PILE  FT02F001? 

y 

EXECUTION  BEGINS. .. 

AUTOCORRELATIONS 

0.954  0.899  0.851  0.808  0.779  0.756  0.738  0.727  0.734  0.744 
0.758  0.762  0.717  0.663  0.618  0.576  0.544  0.519  0.501  0.490 
0.498   0.506   0.517   0.520   0.484 


PARTIAL  AUTOCORRELATIONS 

0.954  -0.118  0.054  0.024  0.116  0.044  0.038  0.100  0.204  0.064 
0.106  -0.042  -0.485  -0.034  0.042  -0.044  0.028  0.037  0.042  0.014 
0.073  -0.033   0.061   0.031  -0.194 

MEAN=  5.54218  VARIANCE  =  0.193531 

ENTER  TITLE  FOR  PLOTS, 
autos  and  pautos  of  series  g  data  /  natural  log  transform 

YOUR  AUTO  AND  PAUTO  PLOTS  HAVE  BEEN  PRINTED  OFFLINE. 

PICK  UP  IN  ROOM  1140  UNDER  YOUR  USER  ID  NUMBER. 
DO  YOU  WANT  TO  GO  AGAIN? 

y 
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ENThiR    LETTER    FOR    OPTION    YOU    KANT. 

d 

IS  YOUR  DATA  IN  FILE  FT02F001? 

V 

EXECUTION  BEGINS. . . 
IS  YOUR  TIME  SERIES  SEASONAL? 

y 

ENTER  ORDER  OF  SEASONAL  DIFFERENCING. 
1 

ENTER  LENGTH  OF  SEASONAL  PERIOD  VIA  12. 
12 

ENTER  NUMBER  OF  NONSEASONAL  DIFFERENCES. 
1 
DO  YOU  WANT  TO  PLOT  AUTO  AND  PAUTO  OF  TRANSFORMED  DATA? 

y 

EXECUTION  BEGINS. . . 

AUTOCORRELATIONS 

-0.341  0.105  -0.202  0.021  0.056  0.031  -0.056  -0.001  0.176  -0.076 
0.064  -0.387  0.152  -0.058  0.150  -0.139  0.071  0.016  -0.011  -0.117 
0.039    -0.091      0.223    -0.018    -0.100 


PARTIAL  AUTOCORRELATIONS 

-0.341  -0.013  -0.193  -0.125  0.033  0.035  -0.060  -0.020  0.226  0.043 
0.047  -0.339  -0.109  -0.077  -0.022  -0.140  0.026  0.115  -0.013  -0.167 
0.132   -0.072      0.143    -0.067    -0.103 

MEAN=0.290920E-03      VARIANCE  =■  0  .  208604E-02 

ENTER  TITLE  FOR  PLOTS, 
autos  and  pautos  for  series  g  s@data  /  1  ns  diff,  1  seas  diff,  In  xform 
YOUR  AUTO  AND  PAUTO  PLOTS  HAVE  BEEN  PRINTED  OFFLINE. 
PICK  UP  IN  ROOM  1140  UNDER  YOUR  USER  ID  NUMBER. 

DO  YOU  WANT  TO  GO  AGAIN? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

c 

ENTER  DESIRED  CP/CMS  COMMANDS,  ONE  PER  LINE. 

WHEN  FINISHED  TYPE:  &GOTO  -QUES 

alter  file  ft03f001  pi  save  ft03f001  pi 

alter  data  ft02f001  pi  serg  ft02f001  pi 

stat 

P  (191):  29  FILES;  267  REC  IN  USE,  29  LEFT  (of  296),  90%  FULL  (2  CYL) 

erase  file  ft08f001 

cp  q  f 

FILES:-  NO  RDR,  NO  PRT,  NO  PUN 

igdto  -ques 

DO  YOU  WANT  TO  GO  AGAIN? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

y 

IS  YOUR  DATA  IN  FILE  FT02F001? 

y 

EXECUTION  BEGINS. . . 

ENTER  LENGTH  OF  SEASON  VIA  FORMAT  12. 
12 

ENTER  NUMBER  OF  NON-SEASONAL  DIFFERENCES. 
1 

ENTER  NUMBER  OF  SEASONAL  DIFFERENCES. 
1 

ENTER  NUMBER  OF  NON-SEASONAL  AR  PARAMETERS. 
0 
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ENTER  NUMBER  OF  SEASONAL  AR  PARAMETERS. 
0 
ENTER  NUMBER  OF  NON-SEASONAL  MA  PARAMETERS. 

1 
ENTER  NUMBER  OF  SEASONAL  MA  PARAMETERS. 

1 


INITIAL  PARAMETER  ESTIMATES  FOR  MARQRT 


THETA(l)  =   0.390425 
THETAS(l)  *   0.534397 

DO  YOU  WANT  TO  GO  AGAIN? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

w 

IS  YOUR  DATA  IN  FILE  FT02F001? 

y 

EXECUTION  BEGINS.  .. 

ENTER  NUMBER  OF  NON-SEASONAL  DIFFERENCES. 
1 

ENTER  NUMBER  OF  SEASONAL  DIFFERENCES. 
1 

ENTER  NUMBER  OF  NON-SEASONAL  AR  PARAMETERS. 
0 

ENTER  NUMBER  OF  SEASONAL  AR  PARAMETERS. 
0 

ENTER  NUMBER  OF  NON-SEASONAL  MA  PARAMETERS. 
1 

ENTER  NUMBER  OF  SEASONAL  MA  PARAMETERS. 
1 

ENTER  LENGTH  OF  SEASON  VIA  FORMAT  12. 
12 

NOW  INPUT  YOUR  INITIAL  PARAMETER  ESTIMATES,  AS  REQUESTED. 

ENTER  NON-SEASONAL  MA  PARAMETER  THETA(l). 
.390425 

ENTER  SEASONAL  MA  PARAMETER  THETAS ( 1 ) . 
.534397 

* 

CONVERGENCE  HAS  BEEN  REACHED  IN  MAX (  7,  7)   ITERATIONS. 


SELECTED  OUTPUT  FOLLOWS: 

PARAMETER  ESTIMATE  STANDARD  ERROR 


THETA(l)  «   0.377152  0.819933D-01 

THETAS(l)  =   0.572387  0.780252D-01 


MOVING  AVERAGE  CONSTANT:  THETA0  =    0.000291 

CHI-SQUARE  STATISTIC  FOR  RESIDUAL  LACK  OF  FIT  =  29.713571 

DEGREES  OF  FREEDOM  =  38 

PROBABILITY  OF  EXCEEDING  STATISTIC  =   0.829438 
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DO  YOU  WANT  TO  PLOT  AUTO  AND  PAUTO  OF  RESIDUALS? 

y 

EXECUTION  BEGINS.  .  . 

AUTOCORRELATIONS 

0.009   0.026  -0.129  -0.105   0.078   0.077  -0.036  -0.033   0.103  -0.050 
0.026  -0.020   0.013   0.035   0.067  -0.130   0.052   0.015  -0.093  -0.090 
-0.027  -0.014   0.213   0.009  -0.042 


PARTIAL  AUTOCORRELATIONS 

t 

0.009   0.026  -0.130  -0.104   0.088   0.068  -0.072  -0.029   0.151  -0.057 
-0.022   0.018   0.046   0.001   0.053  -0.114   0.069   0.029  -0.129  -0.134 
0.042  -0.014   0.143  -0.025   0.013 

MEAN=0.236005E-02      VARIANCE  =  0.139713E-02 

ENTER  TITLE  FOR  PLOTS, 
autos  and  pautos  of  residuals  /  (0, 1,1  )x(0,l, 1 ) 12  model  of  series  g 
YOUR  AUTO  AND  PAUTO  PLOTS  HAVE  BEEN  PRINTED  OFFLINE. 

PICK  UP  IN  ROOM  1140  UNDER  YOUR  USER  ID  NUMBER. 

* 

DO  YOU  WANT  TO  GO  AGAIN? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

y 

IS  YOUR  DATA  IN  FILE  FT02F001? 

y 

EXECUTION  BEGINS. . . 

ENTER  LENGTH  OF  SEASON  VIA  FORMAT  12. 
12 

ENTER  NUMBER  OF  NON-SEASONAL  DIFFERENCES. 
1 

ENTER  NUMBER  OF  SEASONAL  DIFFERENCES. 
1 

ENTER  NUMBER  OF  NON-SEASONAL  AR  PARAMETERS. 
1 

ENTER  NUMBER  OF  SEASONAL  AR  PARAMETERS. 
0 

ENTER  NUMBER  OF  NON-SEASONAL  MA  PARAMETERS. 
1 

ENTER  NUMBER  OF  SEASONAL  MA  PARAMETERS. 

1 
*** 

INITIAL  PARAMETER  ESTIMATES  FOR  MARQRT  : 


PHI(l)  =   0.112699 
THETA(l)  »   0.490883 
THETAS(l)  =   0.533679 

DO  YOU  WANT  TO  GO  AGAIN? 

y 

LNTER  LETTER  FOR  OPTION  YOU  WANT. 

w 

IS  YOUR  DATA  IN  FILE  FT02F001? 

y 

EXECUTION  BEGINS. . . 

ENTER  NUMBER  OF  NON-SEASONAL  DIFFERENCES. 
1 

ENTER  NUMBER  OF  SEASONAL  DIFFERENCES. 
1 

ENTER    NUMBER    OF    NON-SEASONAL    AR    PARAMETERS, 
i 
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ENTER  NUMBER  OF  SEASONAL  AR  PARAMETERS. 
0 

ENTER  NUMBER  OF  NON-SEASONAL  MA  PARAMETERS. 
1 

ENTER  NUMBER  OF  SEASONAL  MA  PARAMETERS. 
1 

ENTER  LENGTH  OF  SEASON  VIA  FORMAT  12. 
12 

NOW  INPUT  YOUR  INITIAL  PARAMETER  ESTIMATES,  AS  REQUESTED. 

ENTER  NON-SEASONAL  AR  PARAMETER  PHI ( 1 ) . 
0.112699 

ENTER  NON-SEASONAL  MA  PARAMETER  THETA(l). 
0.490883 

ENTER  SEASONAL  MA  PARAMETER  THETAS ( 1 ) . 
0.533679 
*** 

CONVERGENCE  HAS  BEEN  REACHED  IN  MAX (10, 10)   ITERATIONS. 


SELECTED  OUTPUT  FOLLOWS: 


PARAMETER  ESTIMATE 


STANDARD  ERROR 


PHI(l)  =   0.146667 
THETA(l)  =   0.509816 
THETAS(l)  =   0.573388 


0.224464D  00 
0.195934D  00 
0.784896D-01 


MOVING  AVERAGE  CONSTANT:  THETA0 


0.000248 


CHI-SQUARE  STATISTIC  FOR  RESIDUAL  LACK  OF  FIT  =  28.302543 
DEGREES  OF  FREEDOM  =  37 

PROBABILITY  OF  EXCEEDING  STATISTIC  «   0.847102 
DO  YOU  WANT  TO  PLOT  AUTO  AND  PAUTO  OF  RESIDUALS? 

y 

♦EXECUTION  BEGINS. . . 

AUTOCORRELATIONS 

-0.013   0.073  -0.100  -0.088   0.077   0.073  -0.031  -0.033   0.105  -0.054 
0.033  -0.018   0.014   0.027   0.070  -0.133   0.051   0.008  -0.092  -0.084 
-0.020  -0.023   0.208   0.005  -0.036 


PARTIAL  AUTOCORRELATIONS 

-0.013   0.073  -0.098  -0.096   0.092   0.081  -0.064  -0.040   0.152  -0.050 
-0.027   0.017   0.047  -0.004   0.053  -0.118   0.055   0.031  -0.123  -0.135 
0.051  -0.006   0.148  -0.019   0.003 


MEAN=0.253052E-02 


VARIANCE  =  0.139373E-02 


ENTER  TITLE  FOR  PLOTS, 
autos  and  pautos  of  residuals  /  ( 1, 1, 1 )x (0, 1, 1 ) 12  model  of  series  g 
YOUR  AUTO  AND  PAUTO  PLOTS  HAVE  BEEN  PRINTED  OFFLINE. 
PICK  UP  IN  ROOM  1140  UNDER  YOUR  USER  ID  NUMBER. 

DO  YOU  WANT  TO  GO  AGAIN? 

y 
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ENTER  LETTER  FOR  OPTION  YOU  WANT. 
f 

IS  YOUR  DATA  IN  FILE  FT02F001? 

y 

EXECUTION  BEGINS. . . 
IS  YOUR  SERIES  SEASONAL? 

y 

ENTER  SEASONAL  DATA  AS  REQUESTED: 

ENTER  NUMBER  OF  SEASONAL  DIFFERENCES. 
1 

ENTER  NUMBER  OF  SEASONAL  AR  PARAMETERS. 
0 

ENTER  NUMBER  OF  SEASONAL  MA  PARAMETERS. 
1 

ENTER  LENGTH  OF  SEASON  VIA  FORMAT  12. 
12 

ENTER  NONSEASONAL  DATA  AS  REQUESTED: 

ENTER  NUMBER  OF  NON-SEASONAL  DIFFERENCES. 
1 

ENTER  NUMBER  OF  NON-SEASONAL  AR  PARAMETERS. 
0 

ENTER  NUMBER  OF  NON-SEASONAL  MA  PARAMETERS. 
1 

NOW  INPUT  YOUR  PARAMETER  ESTIMATES: 


ENTER  MA  CONSTANT  TERM,  THETAO. 
.000291 

ENTER  NON-SEASONAL  MA  PARAMETER  THETA(l). 
.377152 

ENTER  SEASONAL  MA  PARAMETER  THETAS(l). 
.572387 

ENTER  MAXIMUM  FORECAST  LEAD  TIME  VIA  FORMAT  12. 
30 

ENTER  INDEX  FOR  PLOT  ORIGIN  VIA  FORMAT  13. 
100 

ENTER  INDEX  FOR  FORECAST  ORIGIN  VIA  FORMAT  13. 
131 

ENTER  SIGNIFICANCE  LEVEL  FOR  CONFIDENCE  INTERVALS. 
0.10 

WAS  YOUR  DATA  TRANSFORMED  IN  THE  TRANS  PROGRAM? 

y 

DO  YOU  WANT  BASIC  OUTPUT  AT  THE  TERMINAL? 

y 

THE  LAST  10  WVEC  VALUES: 

0.418999E  03   0.461001E  03   0.472000E  03   0.535001E  03   0.622000E  03 
0.606000E  03   0.507999E  03   0.461001E  03   0.390001E  03   0.432002E  03 

THE  30  FORECAST  VALUES: 

0  398539E  03  0.415184E  03  0.395402E  03  0.462697E  03  0.450971E  03 

0  469710E  03  0.543456E  03  0.618194E  03  0.626276E  03  0.524292E  03 

0.460421E  03  0.405213E  03  0.448016E  03  0.46G864E  03  0.444748E 

0  520593E  03  0.507548E  03  0.528791E  03  0.611991E  03  0.696357E  03 

0.705666E  03  0.590927E  03  0.519089E  03  0.456978E  03  0.505397E  03 

0  526812E  03  0.502002E  03  0.507782E  03  0.573220E  03  0.597386E  03 
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THE  30  UPPER  FORECAST  CONFIDENCE  LIMITS: 

0.399598E  03  0.416254E  03  0.396481E  03  0.463785E  03  0.452068E  03 

0.470813E  03  0.544567E  03  0.619311E  03  0.627399E  03  0.525422E  03 

0.461557E  03  0.406354E  03  0.449173E  03  0.468030E  03  0.445925E  03 

0.521779E  03  0.508743E  03  0.529995E  03  0.613203E  03  0.697577E  03 

0.706894E  03  0.592163E  03  0.520332E  03  0.458229E  03  0.506664E  03 

0.528090E  03  0.503292E  03  0.589083E  03  0.574532E  03  0.598708E  O1 

ALPHA  FOR  THE  CONFIDENCE  LIMITS  IS:  0.100 

* 

DO  YOU  WANT  TO  GO  AGAIN? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT, 
f 

IS  YOUR  DATA  IN  FILE  FT02F001? 

y 

EXECUTION  BEGINS. .. 
IS  YOUR  SERIES  SEASONAL? 

y 

ENTER  SEASONAL  DATA  AS  REQUESTED: 

ENTER  NUMBER  OF  SEASONAL  DIFFERENCES. 
1 

ENTER  NUMBER  OF  SEASONAL  AR  PARAMETERS. 
0 

ENTER  NUMBER  OF  SEASONAL  MA  PARAMETERS. 
1 

ENTER  LENGTH  OF  SEASON  VIA  FORMAT  12. 
12 

ENTER  NONSEASONAL  DATA  AS  REQUESTED: 

ENTER  NUMBER  OF  NON-SEASONAL  DIFFERENCES. 
1 

ENTER  NUMBER  OF  NON-SEASONAL  AR  PARAMETERS. 
1 

ENTER  NUMBER  OF  NON-SEASONAL  MA  PARAMETERS. 
1 

NOW  INPUT  YOUR  PARAMETER  ESTIMATES: 


ENTER  MA  CONSTANT  TERM,  THETA0. 
.000248 

ENTER  NON-SEASONAL  AR  PARAMETER  PHI(l). 
0.146667 

ENTER  NON-SEASONAL  MA  PARAMETER  THETA(l). 
0.509816 

ENTER  SEASONAL  MA  PARAMETER  THETAS ( 1 ) . 
0.573388 

ENTER  MAXIMUM  FORECAST  LEAD  TIME  VIA  FORMAT  12. 
30 

ENTER  INDEX  FOR  PLOT  ORIGIN  VIA  FORMAT  13. 
100 

ENTER  INDEX  FOR  FORECAST  ORIGIN  VIA  FORMAT  13. 
131 

ENTER  SIGNIFICANCE  LEVEL  FOR  CONFIDENCE  INTERVALS. 
0.10 

WAS  YOUR  DATA  TRANSFORMED  IN  THE  TRANS  PROGRAM? 

y 

DO  YOU  WANT. BASIC  OUTPUT  AT  THE  TERMINAL? 

y 
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THE  LAST  10  WVEC  VALUES: 

0.418999E  03   0.461001E  03   0.472000E  03   0.535001E  03   0.622000E  03 
0.606000E  03   0.507999E  03   0.461001E  03   0.390001E  03   0.432002E  03 

THE  30  FORECAST  VALUES: 

0.398650E,  03  0.414875E  03  0.395125E  03  0.462366E  03  0.450651E  03 

0.469348E  03  0.543045E  03  0.617700E  03  0.625753E  03  0.523897E  03 

0.460071E  03  0.404899E  03  0.447739E  03  0.466360E  03  0.444325E  0" 

0.520096E  03  0.507066E  03  0.528257E  03  0.611381E  03  0.695632E  03 

0.704905E  03  0.590336E  03  0.518566E  03  0.456512E  03  0.504960E  03 

0.526113E  03  0.501400E  03  0.587074E  03  0.572532E  03  0.596632E  03 

THE  30  UPPER  FORECAST  CONFIDENCE  LIMITS: 

0.399709E  03  0.415945E  03  0.396204E  03  0.463452E  03  0.451744E  03 

0.470448E  03  0.544151E  03  0.618812E  03  0.626870E  03  0.525020E  03 

0.461199E  03  0.406032E  03  0.448887E  03  0.467517E  03  0.445491E  03 

0.521270E  03  0.508249E  03  0.529448E  03  0.612579E  03  0.696837E  03 

0.706117E  03  0.591556E  03  0.519792E  03  0.457745E  03  0.506207E  03 

0.527371E  03  0.502668E  03  0.588353E  03  0.573821E  03  0.597930E  03 

ALPHA  FOR  THE  CONFIDENCE  LIMITS  IS:  0.100 

DO  YOU  WANT  TO  GO  AGAIN? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 
f 

IS  YOUR  DATA  IN  FILE  FT02F001? 

y 

EXECUTION  BEGINS. . . 
IS  YOUR  SERIES  SEASONAL? 

y 

ENTER  SEASONAL  DATA  AS  REQUESTED: 

ENTER  NUMBER  OF  SEASONAL  DIFFERENCES. 
1 

ENTER  NUMBER  OF  SEASONAL  AR  PARAMETERS. 
0 

ENTER  NUMBER  OF  SEASONAL  MA  PARAMETERS. 
1 

ENTER  LENGTH  OF  SEASON  VIA  FORMAT  12. 
12 

ENTER  NONSEASONAL  DATA  AS  REQUESTED: 

ENTER  NUMBER  OF  NON-SEASONAL  DIFFERENCES. 
1 

ENTER  NUMBER  OF  NON-SEASONAL  AR  PARAMETERS. 
0 

ENTER  NUMBER  OF  NON-SEASONAL  MA  PARAMETERS. 
1 

now  input  your  parameter  estimates: 
e;:ter  ma  constant  term,  thetao. 

.000291 

EUTER  NON-SEASONAL  MA  PARAMETER  THETA(l). 
.377152 

EUTER  SEASONAL  MA  PARAMETER  THETAS(l). 
.572387 

ENTER  MAXIMUM  FORECAST  LEAD  TIME  VIA  FORMAT  12. 
40 
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ENTER  INDEX  FOR  PLOT  ORIGIN  VIA  FORMAT  13. 
075 

ENTER  INDEX  FOR  FORECAST  ORIGIN  VIA  FORMAT  13. 
120 

ENTER  SIGNIFICANCE  LEVEL  FOR  CONFIDENCE  INTERVALS. 
0.10 

WAS  YOUR  DATA  TRANSFORMED  IN  THE  TRANS  PROGRAM? 

y 

DO  YOU  WANT  BASIC  OUTPUT  AT  THE  TERMINAL? 
n 

* 

DO  YOU  WANT  TO  GO  AGAIN? 
Y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

d 

IS  YOUR  DATA  IN  FILE  FT02F001? 

y 

EXECUTION  BEGINS. .. 
IS  YOUR  TIME  SERIES  SEASONAL? 

y 

.  ENTER  ORDER  OF  SEASONAL  DIFFERENCING. 
1 

ENTER  LENGTH  OF  SEASONAL  PERIOD  VIA  12. 
12 

ENTER  NUMBER  OF  NONSEASONAL  DIFFERENCES. 
1 

DO  YOU  WANT  TO  PLOT  AUTO  AND  PAUTO  OF  TRANSFORMED  DA1A? 
n 
DO  YOU  WANT  TO  GO  AGAIN? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

C 

ENTER  DESIRED  CP/CMS  COMMANDS,  ONE  PER  LINE. 

WHEN  FINISHED  TYPE:  S.GOTO  -QUES 

alter  file  ft02f001  pi  lnserg  ft02f001  pi 

alter  file  ft03f001  pi  file  ft02f001  pi 

&goto  -ques 

DO  YOU  WANT  TO  GO  AGAIN? 

y 

ENTER  LETTER  FOR  OPTION  YOU  WANT. 

x 

IS  YOUR  DATA  IN  FILE  FT02F001? 

y 

EXECUTION  BEGINS. . . 


IS  YOUR  SERIES  SEASONAL? 

y 

ENTER  LENGTH  OF  SEASON  VIA  FORMAT  12. 
12 

ENTER  NUMBER  OF  SEASONAL  AR  PARAMETERS. 
0 

ENTER  NUMBER  OF  SEASONAL  MA  PARAMETERS. 
1 

ENTER  NUMBER  OF  NON-SEASONAL  AR  PARAMETERS. 
0 

ENTER  NUMBER  OF  NON-SEASONAL  MA  PARAMETERS. 
1 

NOW  INPUT  YOUR  INITIAL  PARAMETER  ESTIMATES,  AS  REQUESTED. 

ENTER  NON-SEASONAL  MA  PARAMETER  THETA(l). 
.377152 

ENTER  SEASONAL  MA  PARAMETER  THETAS(l). 
.572387 
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FOR  THE  GIVEN  INPUT  PARAMETERS  AND  MODEL 

THE  RESIDUAL  SUM  OF  SQUARES  IS:        0.18192935D  00 


DO  YOU  WANT  TO  TEST  DIFFERENT  PARAMETER  VALUES? 
n 


DO  YOU  WANT  TO  TEST  A  DIFFERENT  MODEL? 

y 

IS  YOUR  SERIES  SEASONAL? 

y 

ENTER  LENGTH  OF  SEASON  VIA  FORMAT  12. 
12 

ENTER  NUMBER  OF  SEASONAL  AR  PARAMETERS. 
0 

ENTER  NUMBER  OF  SEASONAL  MA  PARAMETERS. 
1 

ENTER  NUMBER  OF  NON-SEASONAL  AR  PARAMETERS. 
1 

ENTER  NUMBER  OF  NON-SEASONAL  MA  PARAMETERS. 
1 

NOW  INPUT  YOUR  INITIAL  PARAMETER  ESTIMATES,  AS  REQUESTED. 

ENTER  NON-SEASONAL  AR  PARAMETER  PHI(l). 
.146667 

ENTER  NON-SEASONAL  MA  PARAMETER  THETA(l). 
.509816 

ENTER  SEASONAL  MA  PARAMETER  THETAS(l). 
.573388 
* 

FOR  THE  GIVEN  INPUT  PARAMETERS  AND  MODEL 

THE  RESIDUAL  SUM  OF  SQUARES  IS:        0.18164378D  00 


DO  YOU  WANT  TO  TEST  DIFFERENT  PARAMETER  VALUES? 
n 

DO  YOU  WANT  TO  TEST  A  DIFFERENT  MODEL? 
n 

DO  YOU  WANT  TO  GO  AGAIN? 

n 

CONTROL  RETURNED  TO  CMS 

R; 


131 


ft«*»*ftftft*+ft*»ft*«*»**ft#*#»»ftft*+ft#*-*»H*»-»+*»»*«**rft-t-****ft* 


•ft 


*  *  *  4-  * 

*  c 

*  o 

*  • 
«  •* 

♦•4- 

*  —1 

ft 


•  • 


* 

(M* 

•  ft 
CO* 

o» 
^* 

ft 
* 
* 
* 
* 

* 
« 
# 
* 
* 
* 


« 
ft 
♦ 
ft 
ft 
« 
* 
«  in 

*  • 

*  00 
»o 

*  -* 
« 


Oft 

•  ft 

r-ft 
ft 
* 
* 
* 
* 
* 
♦ 
ft 
ft 
* 
ft 
* 
ft 
ft 
ft 

ITlft 

r»-  + 

mii 

•o* 

-* 


■♦■ 
ft 

ft 
ft 
ft 

ft 
ft 
* 
ft 
Oft 

•ft 

— *»   ' 


t  • 


ft    • 

♦  (M 

#r- 

» 

ft 

ft 

ft 

ft 

ft 

♦ 

ft 

ft 

ft 

1/1 

<•> 

ft 

H- 

t-a 

* 

►-* 

>-'ii. 

ft 

zc 

zo 

* 

z> 

2>? 

•ft 

U. 

ft  in 

r-4 

~*a. 

+  f- 

c 

Our 

ft    • 

li. 

*  *o 

at 

t'lU. 

*  m 

0 

lO«-i 

* 

r- 

■oa 

a- 

•-* 

JO  ■»■ 

» 

• 

.3 

» 

0 

O 

•       •     * 

v. 

» 

11 

11 

•♦• 

z 

-   4 

•          ir 

ft 

*  Jr- 

* 

2 

:  < 

•        •      w 

Ul 

•        •  * 

•           * 

Bi 

..O 

ft 

If 

11 

* 

-a 

_ji/i 

•    •           * 

<r 

*/LU 

•  •        »o 

0 

(_>~ 

•     *o 

10 

tort 

ft     . 

1 

1  uJ 

«1 


O 
O 


r- 


o 
o 


m 


IX 


132 


nti^w^i 

•4.-0^03 

o^rcQf- 

•o*tr*ao 

<^<T(\l»-< 

hCOO 

•  .   •   t 

•  >  •  • 

C^Of, 

ocoo 
1      1 

^r->u">.-< 

(Nlcoeo^j 

f-l.^  *-*.-< 

m  j-i_>,-« 

-O-J-iMiM 

<>J<7«>-»0 

♦    •     •    • 

•  •    •   • 

oooo 

Oo«_>o 

^O^fflst 

om>0(M 

m-o-r  .n 

J.(^-OCJ 

O-T^ro 

o<~>oo 

•  •    •   • 

•  •  •  • 

rcoo 

oooo 

1 

mOaoro 

sOtMvOl*- 

>0>-'COt-> 

(Sjfl^O 

^u^mo 

hOCO 

•  •   .  • 

•  •  •  • 

o 

oooo 

OOOO 

1 

• 
eg 

C7> 

rgccoor^ 

03U"v»C-O 

M 

oar<*>rricO 

or-jro^" 

nT 

%OiA>rrn 

OOOO 

*-< 

•  •   •  • 

•  •  .  • 

OOO'J 

ocoo 
1 

tt 

-TOnJ-vO 

^•-Hroao 

I  J 

-^aoi/'rvj 

uO 

NOOJ- 

O 

r»\r\  j-  .ti 

~ 

ir-iP 

i? 

•  .  •  . 

a 

•    •    •    • 

<X 

u- 

oooo 

H- . 

o->oo 

►-» 

2. 

(- 

i   • 

a: 

UJ 

<I 

< 

•— 

nisUlvJLT 

—J 

-j-r-aom 

:> 

i— 

ITV'J'OIU' 

'J. 

CMNI«J"-H 

<r 

r^sOU>CNj 

CT- 

r^0<->0 

_j 

•   •   •  • 

a 

•    •    •   • 

LU 

oooo 

3 

oooo 

en 

o 

1     1 

a 

a 

U 

r-f  >r-f~ 

K 

ao<-»<\jtr 

'_> 

0»— *■— '^ 

J 

m^-iriM 

LJ 

opr—i/wj 

<■ 

OU-iOO 

h- 

•  •  •  • 

.  •  •  • 

0* 

_J 

«-<000 

_J 

OOOO 

o 

«* 

<1 

•       v" 

CM 

• 

<UO^'T 

f— 

i^u^tJUJ 

O 

p-vOOO^O 

Cf 

(\jPI(_>— « 

00 

w^p*-  ,j»  ivj 

<J 

ivho 

rg 

•    •    •    • 

a. 

•  •  •  • 

<-'0,-'0 

uo*->o 

1  1  1  1 

n 

< 

00  fO '""•-< 

cu^OO 

UJ 

<T^u^ 

«rt— >r~ 

A 

o*r-  -tin 

(7>— IOO 

•  •  •  • 

•  •  •  • 

ocoo 

oooo 

1 

133 


<->♦ 

04- 

•  * 

» 
* 
* 
# 
* 
# 


.  #  + 

■f 
+ 


O* 

o-»- 
•# 

"** 

# 

* 
» 
* 
* 

* 

* 
« 
* 
* 

o  + 
•* 

— '* 

# 

* 
# 

* 

* 
# 
* 
» 

o  + 

•* 

^* 

^* 

# 

« 


* 

# 
» 
# 

* 

<->  + 
.* 


'  * 

+  o 

*  • 

« 
* 
* 
« 

* 

* 


* 

*r> 

+  o 

»  • 

»  ~* 

*•  ro 

» 

# 

* 

« 

# 

* 

•♦• 

* 

* 

» 

« 

* 

* 

* 

* 

*«-> 

+  o 

»     • 

*  —1 

*<M 

* 

» 

* 

* 

• 

* 

«/» 

* 

Q 

+ 

2 

# 

< 

» 

CD 

* 

* 

«5 

* 

i 

♦ 

o 

It 

1— 1 

# 

l/> 

3  O 

*  ~ 

IM 

a    • 

K  -• 

X 

*  — i 

t- 

» 

*-• 

* 

3 

tt 

♦ 

(.1 

a 

r 

# 

u 

u 

u 


a 


o 
o 


I 


o 
I 


134 


* 

Of 
•  ft 

ft 
* 

* 
* 
* 
» 

* 
# 
» 
* 
* 
* 
* 
# 

e>* 

o  + 

•» 

^* 
m» 

♦ 


+ 
* 

« 
ft 

» 

« 
o# 

•» 

r-lft 

<NJft 

-> 
* 

* 
* 
* 


* 

ft 

♦ 

ft 

* 

oft 

o» 

•  a 
^# 

* 
ft 

» 
ft 
ft 
* 

* 

# 
ft 
» 

* 
* 
* 

o  + 

•  » 


♦  *«-*ft«»-*«  ■»  + 


♦♦ft******  +***•».(<*  fr  *  -p  +«»1(*»*<,)r> 

ft     + 

+ 

*         + 
+ 

*  ♦ 
+ 

*  ♦ 
ft  + 

+ 


»«««•>»«>»«» 


» 
- 
« 


»  o 


» 

♦ 

» 

* 

* 

* 

« 

* 

!• 

« 

a 

« 

ID 

» 

O 

» 

*- 

♦ 

'J- 

»  U 

a. 

+■  O 

Mi 

<      • 

X 

*  ~-> 

u. 

#  IM 

— 1 

* 

•  CI 

ft 

00^ 

*■ 

on 

# 

-*• 

« 

«*^ 

it 

CC 

♦ 

** 

* 

<T|- 

* 

r<i 

« 

i_>o 

* 

•"■• 

* 

mo 

5 

'. 

(NJLO 

ft 

LLi 

r 

-*o 

« 

o 

» 

—•C". 

V 

ft-O 

fl 

<•►- 

■» 

_i_> 

» 

liJ  <l 

« 

".a. 

♦ 

(X 

» 

Llt-J 

-• 

OiT 

• 

u<I 

» 

t— 

• 

31/1 

»  o 

«tC_' 

*C 

1- 

o 


m 


« 


rr, 


I 


a 

i 


135 


•  * 


* 
* 

* 

* 

# 

(\i  + 
•  * 

CO* 
O* 

* 
* 
* 
* 

* 
» 


U">* 
•* 

<\J» 

* 
* 
* 

« 

* 
* 
* 
* 

» 

# 

•  # 

# 
* 

* 


» 
* 
* 

•  » 


+  **«****»*   +**»i«****#+*****»«»'r   ♦**+*»*»*+♦*■»•*■«♦■»:-**  *+*«-*«*#**ll 


t  • 


•  • 


+  <~> 
«    • 

«  -J- 

*  >*• 

* 
« 
* 

# 
* 


* 
♦ 

*  in 

*  • 
#o 
« 

+ 

* 
* 

* 

*  • 

*  r\j 


2. 
X 

o 


•  • 


# 

<J 

# 

o 

♦ 

_l 

« 

* 

_J 

« 

U) 

(/-.< 

* 

t~ 

l-u. 

# 

•— i 

i-3 

# 

^ 

Zt- 

-ii 

ID 

0«T 

* 

Z 

IS- 

L"\ 

r-< 

f-t 

+  f- 

<-< 

cj-<* 

B 

• 

1 

X 

*0 

VI 

UK 

* 

rf| 

cr 

<DH 

¥. 

p- 

•J«< 

* 

r-l 

(MO 

* 

• 

• 

* 

o 

CO 

» 

» 

II 

II  </> 

* 

2 

s  in 

* 

* 

*  •"• 

'li- 

• 

t  or 

lt' 

'ii 

•  * 

00 

* 

aa 

•  • 

* 

IX 

L.-u. 

* 

_i 

_lO 

■M 

<l 

<■ 

*  O 

o 

oi- 

♦  O 

1/1 

i/IO 

» 

• 

1 

1  -1 

♦  * 

X 

>a. 

•J- 

■« 

136 


«J-C-UM»> 

-r^  ir\v 

^-O^r- 

sO^>ru> 

r^^-m^H 

oooo 

•   •   •   • 

•  •  •  • 

CCOo 

o«-oc 
1  1 

sT— <t>-— < 

j-rvj^m 

rir>f^—> 

C~l-^-(\f 

r»x^"' 

r-jo<->0 

•   •    •   • 

•   •    •   • 

oooo 

ocuo 
I 

r-~T  -Tin 

Or^u"\f*1 

(M^-l«0^. 

O-nflO 

f-uvMru 

-^OOO 

•  •  •  • 

•   •    •   • 

o">o-» 

OOOO 

1  1 

CO  •fO-O 

COCOvOCM 

m«roco 

r<"*(\J*Mrr> 

r>-iri«r(N) 

COOr-* 

.  •  •  • 

•     •      •     • 

—1 

O'-'CO 

oooo 
1 

m 

vo^r-^ 

j->riA-r 

o 

\T<*~rr\  f~l 

•J--JT0O 

~-< 

f^^-Jra 

oooo 

• 

.    •    .   • 

.  •  .  • 

o 

oocv 

UOUO 

1   1  1 

II 

crco  j-^n 

■om>t(7> 

UJ 

r-'-'co— i 

11 

—iv/ctim 

o 

r~  O^-fl 

z 

.-iO^o 

t: 

•  •   •   • 

u 

•  •   ••• 

< 

LT> 

oooo 

*— « 

oooo 

*-« 

^ 

h- 

1 

a" 

u 

< 

<l 

*—* 

UJm>_»U\ 

— 1 

M  ■  >T—>^3 

> 

H 

OONO 

Ui 

>MrocnN 

«; 

J3^u<rn 

a 

r-ooo 

_j 

t    •    •    • 

a 

•  •  •  • 

t . 

<_><_>oo 

LJ 

oooo 

u" 

l_> 

i 

ct: 

(_> 

r 

— <r~-r— m 

h- 

,»•'/> -*0 

u 

\Tlr-f-IW 

3 

IA3J  Or\) 

o 

ODr^lAfVJ 

■a. 

o-ro" 

h- 

•     •     •     • 

•  •  •  • 

ro 

_> 

OO^1-" 

_j 

c<~>r>'~> 

^ 

< 

i    \  i 

CMNisOU* 

1- 

corsi«>^r 

in 

U>  JO* 

a 

^■Trom 

• 

cor~LT\«Ni 

•<a 

huou 

in 

.    •    •    • 

UL 

•  •  i  • 

oooo 

UOOO 

•  1  I 

ii 

z 
i 

-J- CO  CO^" 

■nin1'! 

UJ 

miTiCT*^ 

u\or-o 

i. 

o^r-^-'^ 

i^~oo 

•  •   •   • 

•  •  •  • 

>-»OoO 

uooo 

1 

137 


* 

<->  + 
•  # 

* 

« 
* 
* 

+ 
* 
* 

* 


O* 

O* 

•  * 

r-l* 

■» 
# 

# 
* 
* 

* 
# 
* 
# 

# 
* 

o» 

o  + 

•* 

* 
* 

* 
» 
* 
» 

* 
* 

# 
* 

N 
tt 

o  + 

•  «■ 
<-t# 

* 
* 

» 


-t-****#*»*-x  -f**»*#**-»*-t--»^***^<*»  **x#» 


+ 
+ 


»;:+»*»*  *«***■»■*  ?***■** 


*  +  * 

*  o 

t-  o 

*    • 

»  —■ 

*  •$- 

■»■ 

« 

» 

* 

* 

* 

♦ 

* 

* 

a 

* 

# 

* 

♦ 

* 

*o 

+  o 

*   • 

*  —< 

*  m 

* 

# 

•>e 

* 

ir 

* 

♦ 

* 

* 

* 

* 

* 

* 

» 

* 

t»o 

*■'.} 

«    • 

*  -< 

a  -j 

* 

* 

* 

* 

• 

# 

<s> 

# 

Cj 

■f 

^ 

«■ 

< 

? 

00 

* 

# 

< 

* 

•i. 

* 

u 

* 

t— < 

* 

C) 

*  C 

+  o 

(M 

r-     m 

*  r-> 

X 

00 

Z 

U 


* 
# 

* 

o* 
•  » 


or 

c 

•a. 


O 

u 


-4J 


O 

I 


O 

o 


o 

I 


138 


1 

Of 

.« 

^* 

* 

# 
* 

* 
* 

* 
* 
« 

* 
» 

* 
o* 

.  » 


# 

* 

« 

* 
* 
* 

o* 

o* 

•# 

^» 

» 

* 

* 
» 

* 

* 

* 
* 
* 
* 
* 
# 

o* 

o* 

•■»<■ 

r-1* 

« 

■» 


* 

o  + 


♦*»«#«»«H+«#*»«|l*f>*t»#*<»«»+ln;ir|(t»v,|U.   t»4,,v.#w<;jl4<1t<i. 


«»■»:» 


*  + 

*  ♦ 

r 
»  + 


#  ♦ 


*  "" 

*  o 

*  • 
«  •-■ 
»  >r 
♦ 


* 

* 

*  o 

■f  o 

*  • 
«  - 


*  * 

+ 


« 

♦ 

» 

1 

o 

* 

1 

* 

T 

« 

tt 

41 

C 

• 

UL 

« 

u^ 

fc  O 

S- 

♦  o 

<; 

»    • 

nC 

»  —< 

H 

*  og 

M 

•O 

f 

i/iC~i 

B 

o_i 

* 

•^ 

1 

<^ 

« 

as 

* 

<r 

J» 

<  t— 

M 

3T< 

X 

on 

•i 

M 

« 

lOO 

i 

* 

ogi/i 

* 

L'j 

«  o 

T  •— ■ 

f  ^ 

^OC 

»     • 

•—>'.> 

*  —i 

S</1 

#  — t 

-^ 

1/5  U. 

• 

Z   1 

* 

l_> 

* 

L    1 

» 

r<a 

* 

iV 

«. 

3  } 

■» 

o^ 

1 

f~< 

1 

(- 

« 

Z>uO 

*  o 

«?'-' 

+  <-» 

>- 

»     • 

_l"3 

*  «J 

o 
o 


.I 

pi 


o 

i 


139 


I  i  I  i  I  i  I  i  I  I   i  i  I  i  l  i  i  i   i  I  i  .1  I  i  i  1 

r;  i'  i  i  i'liu-c'l  u  i  ja.'j'i_u  i."iJ  /'i;  u.ii'L  urn.  u. 
rjr».j-pi"'v_#«*ju»(voc  •-imf>-CJr»-nT—  i'i.aji~-OM\jcDir>uj(ri 
C~  'j>  <r  o  i  o  u-  to  o  o  tr  u  o  p.  r  J  gv  co  o>  o  c  u *  <J-  <~> «  m  v  —>  _< 

l_           oO»«3-»-<r'«.r-£"i,tJ>t"— 0<Pro-f<~  u>~  »-^-c\j«"nr-ic\jou\Q 
<_>  •••••■•••• • 

iii     i  i  i  i     i       i  i  i  i  i  i  ii     r 

IU 
»— 

<J  r*—*rM        f\JOrO-^IMi-<'^»H_4<MrvJ.-HOJi-l(\Ji— <~H<— «,-«r- "■—•_« 

<-  III  I       I   I   I   I    I   1    I   I   I   I    I   I   I   I   I   I   I   I   I   I 

<  '.y  Jji_.  i>*u.'tV.Jl",itl,L>iu;wiriuu,u>uiu_'u.  uii-U'u  ium 

cc  ,j-»*ir\  rricrvrsjcTsf".  mo  —  o-TuJ<<">^(\!^r<-><JNr-r--o<\im 

<J3  o<-'-*  r-O'f*  — «iro  ""-'fm  com  Org  ->  ir  o-mt—! ,_, 

h-  ,j-oo>0  u*->-.o-J"e*r-(rr"vUc*Oiri;j>coo.-«i\ioO",-ON>" 

C  r\J^OC       -J"»J-  357>-3— '— t  ~>  vO  r- nl  1C -0  O  A-O  DlTCO  "0'.Tlr-l 


<       I  I        II        I         III  III  I 


> 

OUC~OOCCCOCOUCCCC  <-»0»-»OOOOOC! 

I   I  I   I  I   I  I      I   I   I  I  I   I  I   I  I   I  I  I  I   I  I  I      I 

uj-l-l.  L-iXOJi.  ivyju.'Si'iuu  I'.^.trii-L.  i-;j:y.  aji_u.".'Jt«j 

(MfSJCC<f-^vt  ^-(^IPI^fVjn  ioO(\lcoCJ'-,'-r  LOrj-frHr-  :<-• 

ooo1"  ix^a^^iT^C'f-c^o  jd 0s  >r- inject  >  a* '-* —i  i>- o 

0<UNj-rriir>-rr^O>00>(TT300^-CO,oCcr>fM<M'^-fNJCO-4-tVJ 
tA  "  1  ~}-  rr,  C.  r—  (^  J  j"\  <—  -O  (NJ  i"l  r-4  O  u '  en  (-  **•  in  <M  eo  —*  <^J  lf\  O  O 

f\j«-*irsrgr»-j'  cr,r->c^-f  ^c^-Tp- t^4-f^<rr^ry\nr\  0(vj*-'f-« 

ooo*ioorooon.«.ooocooo-)Oorooo 
I      I   I  I  I         I  I  I      I  I         I 

o     c->uouaoooioooolJ'DO?oor'uoo 
I      I      I   I  I  I  I  I  I  I  I   I  I   I  I   I  I  I  I   I  I  I      I 

U-         II'CIU    U-Li.  -U\.iJl_U.'U.|i    L.     i    U.u-l,^J.,UJ'Aj<±iJ'»J\iH± 

•—•        ut     r- t * u \o r*-o r- w-* hn oo *-* r— <r  o <& *o\r\**<4 a>p*por-n lp 
a.  hi      cr»in  .POajij'-j>'^>*->roO*cJ,'"",.r\,-,>CT<.-«,r'>i_>CT>Lj.-iaoc> 

O  in      c-fon'JUH?OOU,J)M'lO"l")'T>H-Tril'U-)Uin 

u.  •  •••••••••»••••••••••••••• 

m        oooo-~o^~o"->o<-"JOOcoooocoooo(-'o 

O  I  1111)11  I    I    I         I         I    I     I 

I— 

UL 

oouoro^onououootiuouoonooooo 

iii      i      i  i      i  i  i  i  i  I  i  i  r  t  i  i  t  i  i  i  |  i 

UjOtXiu.  u_a  u.  v.  j.ia;^.LjuJii'a.jjjuiLu.LLa.i_;A;iijiuiuijLi 

li:  oo*-,uo-'U'U"»'o>POw'Oi.'uuu,-H,Ai^j\u<o^'J,r- 
-j  p-i— iu<r-— 4^uir- <Mj>-«t.~>or-oin<r>tJcAu>roof>Ji7<(\|CDoo'-» 
.-«        — «cr— ic>- •  ».j-m,-ivj->j-'— •-"~>.-«>oiJ,33  — <,of--*T-or-  -o 

r<l  m  f**  "-*  -j-  «-•  ir\  -^ "~"  lt\  n '  **  -f  —'  m  .^  ^<  m  r\i  <-<  oo  ■— i  •-<  m  •"•  —t  cr 

t.'  ooooooooooooooooocoo  ioooooo 
->    -^  i   i  i  i  i        i    ii    ii 


140 


13 


>Uf— •-•>J- 

nir-uif-- 

r^.-■ll^lr<1 

sj-voor- 

C^OO 

O— lOO 

•  •  »  • 

•  •  •  . 

1    1    1  T 

OoOO 

1  1  1 

•£•- 'co  in 

>Of^^tr\ 

^-j-*,_, 

<M^^^- 

HUCU 

MOOO 

•  •  •  • 

•    •    •    • 

ooo«~> 

1  1  1 

UOOO 

1 

-^Ot^r-t 

OmO<> 

C,~4.rr* 

<M^^tro 

oooo 

O^OO 

•  •  •  • 

•    •    •    • 

1 

o-»oo 
1      1 

rg 

o—tor>- 

O»o,l'>t 

O 

int--m«T 

■UM>rm 

1 

oooo 

OoOO 

U' 

•  •  •  . 

•  »  •  • 

>X 

ccoo 
1     1 

OOOO 

1         1 

O 

NO 

00 

.-IC^OO 

moo^ 

O 

rr,rr\~fr-4 

d^-HO 

(M 

C  hC  O 

o.-ior-i 

• 

•    •    •   . 

•  •  •  • 

o 

1      1 

O^O"-" 

1  1  1 

II 

vOOOfM 

cOf\jrrlrO 

LJ 

ITMAOlTl 

CO 

rorgo™ 

o 

— •-^-H-J 

Z 

nc-*o 

z 

•    •    .    • 

O 

•   •   •   • 

< 

cuuo 

l_4 

O'-'rpO' 

►-• 

•  1 

t— 

cc. 

O. 

< 

rHUJUIJj 

_l 

ut-mt 

;> 

(\)LO^^ 

111 

r\if-<o*"* 

OOOO 

cc 

•-<000 

•   •  •   • 

U- 

•  •  •  ♦ 

oo<-»0 

1  1 

l_> 

O 

<->ooo 
1  1  1  1 

(_) 

m 

t\JC\jrr>(\J 

h- 

fiom'-1 

o 

Otr><M<M 

Z) 

u-o^^ 

I 

rvj^^rvjt-H 

< 

— <— ihO 

OJ 

•    •    •    • 

•  .  •  • 

o 

"■^^O^ 

_i 

oooo 

>M 

i       7 

«1 

1      1      V 

U» 

»~* 

o 

ui»»<-i,o 

H- 

^•orjin 

{f> 

OC0LT>C7> 

Cl 

Tor^'H    ' 

IM 

«rno>-" 

«* 

UflOO 

• 

•    •    •    • 

Q- 

•   •  •  • 

<_> 

_->oo«-» 
1  1 

UOOO 

1  1  1  1 

II 

z 

'-'•t  &•& 

HNIM^j 

LJ 

>T-CCr\{f\ 

>»■.$■  cia> 

X 

(•OOOO 

rr»o-*0 

•    •    •    • 

•    •   •   • 

oooo 
1         1 

UOOU 

•        1 

141 


•  » 

—* 

-4"# 

* 

# 
# 

* 
# 
# 

* 

# 

* 

« 

* 

* 

# 

* 

O* 

O* 

•* 

-«* 

* 
* 


* 
* 

♦* 

* 

» 
* 

* 

* 
« 

* 

-I* 

* 

* 
* 

* 

* 
* 

•  * 


*•«**•**#*♦**»<•*«#***■♦•**»* 


*  + 

+ 
+ 
•f 


+ 
*  ♦ 

'•♦■ 


♦  * 

*  o 

*  o 

*  • 

*  H 

*  -r 


» 
« 
* 
* 
* 

*  • 

*  «H 


+ 

+ 
+ 

*  +• 
+ 
+ 
+ 

*  ♦ 

+ 


X 

* 

* 

* 

ir 

* 

*o 

t-O 

*    . 

*  -t 

*fNi 

» 

«■ 

* 

» 

• 

* 

</l 

* 

u 

+ 

z 

* 

o 

* 

a) 

* 

* 

<i 

♦ 

a: 

* 

o 

* 

»— * 

» 

i/> 

*  o 

■*<_> 

<\l 

«•    • 

»  I-l 

X 

*  —4 

h- 

* 

i— i 

* 

3 

IT 

» 

</l 

* 

^ 

* 

«— ■ 

• 

•* 

* 

OC 

* 

o 

♦ 

u 

*  o 

u 

■t-o 

1— 

o 
o 


r<1 


o 
o 


142 


o* 

o-t- 

.» 

—"* 

* 


«  +  ****«♦**»+»#*♦*»♦■»*■♦•***# 


*  -T 


* 

* 

# 

* 

* 

* 

» 

# 

o» 

o* 

•» 

-** 

* 
* 
* 
* 
+ 
* 

* 

* 

* 

* 

* 

o* 

o* 

•* 

-*# 

* 
# 
» 

* 

* 
* 

* 

* 

* 

» 

» 

* 

* 

* 

c-* 

o  + 

•* 

~i* 

* 

* 
* 
» 

* 

* 
* 
« 
# 

* 

# 

o  + 


+ 


*  + 

#  ♦ 

+ 

*  * 
t 
* 

+ 

*  ♦ 

♦  + 

#  + 


*  r> 

*  • 

» 

» 

» 

* 
« 

N 

« 


» 
« 

r 
« 
* 

n 

M 

« 

»  O 
+  'J 
r     • 

»  — < 


SI 

< 


t 
#  ♦ 

+ 


'/I 
•  -» 

(.1  ~ 

CD 
<■  K 

i/-,o 

U.' 


—  . 

ya 
o 

— io 
i-  □ 

•B  t- 
-»3 

lt  a. 

u. 

>->c_i 

O.' 

1-1  «J 
►• 

—  •A 
«3(   l 


i 


r- 


I 


c 


a 

j. 


143 


"-'  —*  "-*  ™  — "-*  <M  ~*  -*  ~*  *"  ^  — •  ""  "~*  *~"  ^  <M  — '  *- '  **  — '  «M  •" ■  »N  r* 

I    I    I    I    I    I    I    I    I    I    I    I         I    I    I    I     I    I    I    I     I    I    I    I     I 
U'V.l'U.  i;   r  iif  i:-U|--L   V  LVt>.'ULLL'U.'LVb.'U;ii.  U  I'-ii'lA-. 

r^  ^  <~>  rn<~-  a-  ^  o  —  w  o  c»  tru  cr  co  u-  c  <->  J-  c*  <->  (M  w*  — « ^ 
—j         ■«^;<rc-0'lN''~  m ■#**!— i\jr- i^j"  'niu>-ii~-i-,"aD>"^,_,C-0 

<_)         ••«••••••..•......•.*<•••« 

III       i   i   I   i       i  i   I   I   I   i   I  II       I 


£_>  III  I  I     I     I     I     I     I     I     I     I     I    I     I     I     ■     I     I     I    I    I     I 

«  UiLUUJ       UJU.,U-.Jl_.UJl"U-L  '.(•IJlMll  U  ^••*»j-Uitl-:UlLIUL|UJ 

i/l  v^o      i-icju- u»<o-£)ir\'^-4< -Arotvrg^iAr-iNJ>0(\l^-f\|ao 

a.  -Hi^iinr' LA-j~-inr>cDiri.-«f\iO'-<'>Jr~— if^-^r^^ifvjrvimrn 

_j  ooorooioiooooooo3iocoooooo 

<  l.l  ii  i  ill  i   i   I  I 


> 


-l-*_(.-^^-<f->e--f\J.-l,-(r-*,-,..J.-<.-jr>Jr\J_«.-<^.-l.-He'.-< 

OOOPUCOP";OCL'CO'.|r<-,OOCOOOOOO 

I   I  I   I  I   I   I      •  I   I  I   I   I   I  I  I   I   I  I   •   I   I  I       I 
i  ;a"o.:i.:J'«jU.  jju  li.u.'t-'L'iuu.'U.i'  ~jl  u.ll'ulu^il'ii.'ui; 

c  >e-4r<"\ir,»i-f-9\~c,,e*::oc~  o*i'co':oocr*'MrNjr-<vco>j-tM 

inri*i<rt<ir^.Nin-<oi'Mni-"ci<',i<ir>NinNW-<NiAeo 

C^_<r-r..—  (\ir—.-«,^M<.— iuji\ir—i\jlrj«-/c;>^cOr'"l>3"'>J"lMN)«^ 

odc:o3oo-locco«cc:ooooooooo 
I      I  I  I  I         I  I  I      I  I         I 


,r,      ,-ir  ~->r+r4r- 1^1— i,^rg_i.-»-'(\j---<,H,^^,-i.-«-<-^»* 

o    opcoo<-"looc,ooouo(jcp''joooro 
i      i       i   i  i  i  T  '   i   i   i  i   i  i   i  i   i  i   i   i   i  •       i 

i— i  ir\      r«c"  u^o^~0^-co^-^I~cu^-lr~•O^OlJJ-Ul^^^^Jm^~^nf-^C', 

it.     mrom<r-ri->os'sJi-t'''roi,<3<^>,J,<six  -r^tn-JTvir^m 

»-<  y>       cu—J.-l_or\jrr|  .JiJt\l—''J'tf>D  JMTi  0"-'-j"OPJ-*J"JJf\Jt/N 

r>         (*^  *~>o  ■-!  L^(M<u,-n(Nj-*u^vC,W'_,fnra-\j  •"•<-•  i\jr>j>-i-*r-j_i-*' 
a.  •  ••••••■••••»••••••• 

CI  uOUOUOOUUOOfOOOCUOOOOUOOOO 

O  I  i     I  I  I     I     I     I  I     I    I  I  I     I     i 

►-■ 
u. 

lit        i        i    i       i    i    i    i    i    I    l    l    i    i    I    I    l    |    I    |    I    I 

Lull  LuU.1.     u.li^U.UL.  l_  *L.i_U.'mLL  vUU.  1— ■  Lu  J-.  LU  LL<-<  OJ  u- 
l,iP)f\Jl_»sr,^U\l,"*w^rnLM^'^,~ trri«ilj*.^-iMs4j^Mr">4rNJf*l'4^ 

_ j         f^-r-tu  »r*^^"J  m«— •>4j~c"^L.,r-ou**T'</<r>tJ*1'MV->r^ur"^uul-»LU 

u.  u,w'u>Pi^'Uuu,rt>J  o**'',iOC',rM0ur\j(»ir~<->'—«T>»  mow 

mm^,,,"",<rr-1"  in  •-*'-*  Ln<<"*~*Nj-i— ipi.— i^rOfM1— <uj»— inniHiHy* 

ai        oooocoooo  jooo^ocooonuooouoo 

_J       rH  I  I     I     I     I  i  i  I  II 

—      rt> 

U.      — 


144 


■C'-'-'-T 

i'ir-uir» 

h-Jinci 

*r>0Or^ 

C-hCO 

OHUQ 

•    •    •    • 

•     •     •     • 

oooo 
i  i   i   i 

oooo 
1  I  1 

■o^ttiirv 

Occir-tf^ 

r*-— <r-t-* 

tvj^-i-J-^ 

r-lCOU 

'XOOO 

•     •     •      • 

•   •    •   • 

uouo 
t  1  1 

oooo 
• 

r-l-Of^H 

r)(f\f  cr 

'3-<^-n 

rg^CT-O 

ooco 

O-^OO 

•  •  •  • 

•   •    •   • 

oo->o 
1 

oooo 
1      1 

rj 

OhiN 

o*o-t<* 

o 

ITlT"*^ 

rf>f\j<r  rO 

1 

OOOL' 

<->oeo 

LL' 

•    •    •    • 

•  •  •  • 

vf 

oooo 
1      1 

oooo 
i          i 

aj 

t-*00>C' 

in^o^ 

O 

rV1^"J 

r^vf  r-<>0 

oj 

0-H">0 

O-^Or-t 

• 

.    •    •    • 

•  •    •   • 

o 

coou 
i       i 

•-lOOO 

1  1  1 

II 

>0OO,SJ 

mr-jmm 

IU 

unino^i 

I/O 

mr\|o<\j 

o 

O— !—••-* 

Z 

OOHO 

2: 

•    •    •    • 

LJ 

•  •   •  . 

<i 

UO 

0~><JO 

•— < 

ooco 

m 

l_ 1 

1   1 

< 

1  1 

•a 

— 

^*(D*jl#CD 

—I 

mr*r*w' 

> 

h- 

<\Jir\.-ir^ 

JJ 

'^r-sJ^ 

J 

C^Oi-Jr* 

Of 

•-•aoo 

—j 

•    •    •    • 

a 

•  »  •  • 

,u 

0>~><-»0 

a 

ooou 

or 

<  1 

o 

1  1  1  1 

X 

a 

ro 

LJ 

<\J  f\J  f»l  (V 

i— 

micffiH 

O 

i-> 

c~m<\4(\i 

_> 

CT-O^^ 

1 

U 

r\j,-ti^,— i 

< 

r-«— l-HO 

LU 

1— 

•    •   •    • 

«      •      •      • 

o 

J 

<_)»_»  c>o 

—i 

^ooo 

INI 

VI 

1         1 

<i 

•     1      V 

o 

u  \r— ~nu 

>— 

ni?N»' 

c> 

LrfUJU^U' 

or 

r-inir»-»-< 

<M 

—.rM<_».-i 

-■■* 

OfiOO 

• 

•     •    •     • 

a. 

•   •   •   • 

u 

»_>0»-»v-» 
1     1 

oooo 
I   1   •   I 

—eTLP-r 

■-ir-(MNO 

ai 

»T  ^nu> 

<t~trCiO* 

a. 

rOO«-»o 

iflOnO 

•    •   .   • 

•    t   •   • 

oooo 

i           i 

oooo 
1          1 

145 


.* 

* 
« 


*+*»***«**#f*# 


*******   t**l«M»<«+( 

*  • 

*  >r 


♦  ♦ 


» 

* 

o  + 
•♦ 

-*« 

m* 

* 
* 

* 
* 

* 
+ 

* 

# 
* 
* 
* 

* 

o* 
•# 

'-It 

* 


* 
* 
* 

♦ 

o* 

*-<*■ 

* 

* 

* 
* 
* 

* 
* 

* 
* 

* 

o* 

•  » 


* 

*  ♦ 

*  ♦ 


*       ♦ 

♦  * 

+ 


* 

* 

* 

* 

* 

*o 

♦  o 

*    • 

»-H 

*rt> 

* 

Jt 

« 

* 

* 

* 

•»■ 

*■ 

* 

• 

» 

» 

* 

* 

* 

*  O 

+  o 

*   • 

*  -* 

*  <>J 

* 

» 

* 

# 

• 

* 

!/) 

» 

Q 

♦ 

^ 

■r 

< 

« 

en 

* 

♦ 

< 

* 

T. 

* 

u> 

!« 

»— • 

■» 

l/> 

*  r- 

+  o 

l\J 

r     • 

*    r-< 

X 

»   •-! 

t— 

* 

*-• 

r 

!£ 

* 

* 

OO 

* 

21 

* 

U 

■f 

•-« 

♦ 

►- 

* 

<r 

* 

* 

+  C 


I  .-I  *i 


o 


I 


146 


tJ  + 

•  a 

* 
* 

* 
* 

* 
* 
+ 
* 
# 


•  * 

* 

* 
* 
* 

# 

* 

* 
* 

<->♦ 
.# 

* 
* 

* 

* 

* 
* 

* 
« 

« 

* 
•  * 

» 
» 

II 
ft 
« 


* 
* 

« 

•  » 


♦  #  ♦  ** 


*  + 

*        + 

+ 

+ 

*  + 


*  *  ♦  » 

»    • 


« 
» 

# 

»  O 
♦  O 


+ 

I-       ♦ 

t 

+ 
+ 

* 
+ 
+ 


« 

ig 

r 

(/I 

» 

■• 

.-, 

« 

» 

■ 

» 

a. 

* 

w 

«  o 

^ 

♦  i  j 

U 

»    • 

«  — < 

o 

»  <-j 

Z. 

« 

• 

« 

'^.-i 

< 

o 

■» 

^>v 

» 

< 

• 

cr< 

♦ 

»- 

« 

<i 

* 

»-l_l 

a 

t> 

* 

~o 

» 

KO 

« 

i/- 

r 

rvj.rj 

t»  ^-* 

* 

«  .-• 

n. 

* 

i/'i_i 

« 

7lL 

* 

L> 

« 

-^Ll 

1 

K-'J 

» 

«Jr- 

» 

—  -1 

« 

■^^ 

« 

a  -v 

• 

OL 

( 

un 

» 

U7- 

• 

<-'-r 

-      <I< 


o 
o 


I 


I 


Ci 

o 


147 


c-«->«rio 

!"■)  CI>U 

mi^r-ro 

uioim-r 

coc.c 

OHOC 

•  •  •  • 

*  •   •  • 

orrO 
Mil 

coop 
I   1   I   1 

rof0^^ 

•-<o«io 

t-;c7<fvjrvj 

inrvjrvir-4 

.-«_><- o 

MHUP 

•  i  •  • 

•  •    •  • 

wouo 
1    1    1 

OOOO 

III 

rnuicvjrvj 

(fOiHH 

O-*0"C 

(M<\JO»^t 

OOOO 

OOOO 

•    •    •    • 

•  •   •  • 

OOOO 

1      1 

OOOO 

1      1 

f\l 

•urgr-iO* 

CMCT^fM 

o 

[-!U->_,co 

r-OfMcu 

1 

COCK 

OOOO 

ID 

•  •   •   • 

•  •    •  • 

f*> 

OOOU 

1      1 

OOOO 

1 

— 4 

r~oN>u 

eo^oo«»- 

m 

f-rn-j-o 

■Oi-Ioof" 

f-i 

OHOO 

OHOO 

• 

•  •  •  . 

•  •  •  • 

o 

<->oco 
i      I 

<-iooo 
1      1 

it 

cor—rsj'-' 

0O(f\rCl*t 

UJ 

r->c*0D 

LO 

*mr-<r- 

u 

OO-iO 

Z" 

oooo 

z 

•    •   a    • 

□ 

•  •   *  • 

< 

1/] 

00">0 

.—. 

OOOO 

•-I 

^ 

1  1 

»- 

1 

ac 

l_l 

< 

«I 

»— < 

•  'inco 

—I 

«*■>-«  IHOJ 

j> 

t- 

OKIOC 

LU 

OONO 

< 

HOC> 

QC 

t-iOOO 

—* 

•    •   •   • 

or 

•  •  •  • 

-J 

ouuo 

o 

oooo 

a 

i 

o 

1      1 

of 

o 

i\» 

CJ 

o^fOmfM 

»- 

OOniU1 

O 

o 

lNrH^J«t 

J 

m-r-xrg 

1 

u 

^-n_ir\i— i 

■a 

— <0"-,'H 

Ul 

t- 

•    t  •    t 

•  •   •  • 

m 

ZD 

o»-»t_>-> 

_j 

OOOO 

«_» 

I 

1            1 

« 

1         v  1 

O 

,00-TsJ- 

r— 

•O00>f » 

m 

(NJCXJ  •-*•-< 

ct 

(\l*-l^l\4 

(M 

UUU-' 

«»» 

OOOO 

• 

t  •  •  • 

a. 

•  •  •  • 

U 

uouu 

1  1 

OOOO 

1 

M 

< 

(/•vOP-rri 

wrorsico 

ai 

UIMI\1J 

of\j-rin 

«. 

uooo 

oooo 

•  •  •  • 

•  •  •  • 

*  1 

UOOO 

1     1 

148 


* 

♦ 
* 


« 
o* 

•  » 

* 

* 
* 
+ 

* 


•  ♦  * 


* 

o* 
•  * 

* 
* 


* 
» 

« 

» 

c* 
•» 

-I* 

— 1« 

« 


* 

K 

«• 

.  » 


*  + 


* 

*     ♦ 

+ 
+• 

+ 


«  *-> 

•  • 

*  — 

a 

* 
* 


* 

*  o 

*  • 

«  —> 

« 
* 
* 

» 
* 


*  * 


+ 

*  ♦ 

*■ 


*  • 

* 
» 

■i 
» 
* 
» 
• 
t 
-» 

*  O 

*  o 
«    • 

«    .-I 


"> 

Q 


< 


O 


o 

o 


I 


I 


149 


•  * 

-I* 

* 

* 
* 


•  * 

.-I* 

* 


*  + 

*  + 

+ 
+ 

»  + 

*  ♦ 

*  ♦ 


* 
* 
» 

* 


* 

* 
* 
* 
* 
* 
« 
* 
* 

•  * 

* 
* 

* 
* 
* 


■«  • 

■a  -< 

» 
* 

* 
# 

* 
* 
* 


*  o 


*   r*» 


*  + 
«      * 


#  ♦ 

♦        + 

*  + 


u. 

o 


♦ 

n 

* 

3- 

» 

* 

rj 

■tt 

»H 

■B 

-» 

* 

r-l 

f 

» 

*  o 

.-< 

♦  o 

•> 

» 

^ 

o 

* 

-* 

w. 

x.  (\J 

X. 

« 

•  --» 

* 

</>^H 

* 

<-J    . 

" 

2?  ^ 

* 

<J     . 

« 

o)o 

♦ 

-^ 

3 

«l 

* 

Z"v 

* 

(J 

* 

•-"(/■; 

* 

i/>_J 

* 

<t 

£- 

N3 

* 

C 

»  r 

X>- 

♦ 

o 

i—  i/l 

■o 

• 

H*ill 

yr 

•h 

■<iy 

■» 

—* 

» 

</)u. 

« 

r?c- 

♦ 

tj 

« 

i—ti 

* 

>-<-» 

* 

<n- 

T 

-<_> 

* 

IV  «2 

V 

cr  n. 

* 

« 

« 

'_)(-! 

# 

u^r 

# 

U<3 

* 

^- 

* 

I3i/> 

» 

D 

«n 

♦ 

l_> 

t- 

■r 

• 

jj 

<J 


«1 


I 


o 
I 


150 


-JVj-PIIM 

0"<lNJ«J" 

LOfD^P"! 

LOf*^rn>j- 

ocoo 

o^oo 

•  •  *  • 

•    •    •    • 

oooo 
i  i   i   i 

<->ooo 

till 

inr-i''~f- 

f\jC*1,-«Ps| 

OC^^Jrvj 

LO^If*!— « 

rfUUC 

—•^oo 

•  •    •   • 

•   •   •   • 

oooo 
1  1  t 

1  1  1 

„,C0-T(\1 

o-iv'.t 

r^OrOio 

>TrriU«4- 

ncpor1 

0«->0O 

•  •  •  • 

•    •    •   • 

ooco 
1      1 

ocoo 
1     1 

<N 

H^-ro 

sl-LT\,NJpd 

o 

n«>'-"ao 

^LO'^aJ 

1 

^UCJ 

oooo 

UJ 

•  .  •  • 

•  •  •  • 

ro 

coca 

oooo 

i 

•7- 

nficof* 

—•COOCvJ 

<^ 

r-rn^trri 

CO— <l — r- 

— < 

nnno 

o— Co 

• 

•  .  •  . 

•    •   •   • 

o 

COOJ 

1       1 

oouo 
1        1 

II 

r»r>vO<N 

Mf*l<T>(\| 

LU 

r-r»-*vn 

<-/j 

CTiTVOxO 

<_> 

ocoi 

^ 

OCOO 

^ 

.  •  •  • 

u 

•  .  .  • 

< 

1/1 

C  DOD 

— • 

uooo 

»— 1 

z 

1    1 

1- 

1 

a. 

a 

<J 

<l 

*H 

cor-Lor- 

— ' 

>4j  g-u>  CO 

-> 

t- 

co<\jor» 

LI- 

L^O^O 

<T 

©CiO»~: 

Tr" 

OOOO 

_l 

•   •   •    • 

ac 

•    •    •    • 

..a 

(JOUC 

'_) 

oooo 

it 

1 

<_> 

1  1  1 

CL 

O 

N 

!_/ 

O^I-UJ-J- 

r- 

COf-OOO 

o 

U 

o—«OLn 

_> 

cr  ^■•rrrt 

1 

LJ 

-lONJ 

■a 

Oo— '<-* 

LU 

h- 

•    •    •    • 

•    •   t    • 

INI 

3 

OOOO 

_i 

ocjovj 

LT\ 

<=■ 

1         1 

<i 

1          1 

o 

NH 

v 

P! 

<<icor,i.-t 

»— 

"ir-^r- 

in 

r-i-iiNii-t 

LI 

hHQN 

IM 

OO' .*•-< 

•Sfc 

oooo 

t 

•    •   •    • 

a. 

•   •   •   • 

o 

OOOO 
|     1 

oooo 
1 

II 

mmo^ 

ror-^-t"! 

LU 

HMlMr- 

rf-\i',-l-0 

-*- 

OO^JO 

oooo 

•    t    •    • 

•  •  •  t 

oo<->0 

1      1  1 

oooo 
1  1      1 

151 


04. 
•« 

-<# 

* 

# 

* 
* 
* 

* 
# 
* 


o* 

o  + 
•  * 

* 
* 
* 
» 
* 
# 
+■ 
* 
# 

# 

* 
* 
* 

•* 

* 
* 

* 
* 
* 
» 

* 
# 
* 
* 
* 
* 
* 
# 

•# 

-** 

-■# 

# 

* 

# 

# 

# 

# 
* 
* 

* 


****** 


#»*  +***** 


fJi+*********+*-»>-»»   »,>!*« 


*  O 

*  • 

*  — 1 
»  -I- 

* 


■f 

*  ♦ 

#  ♦ 

*  ♦ 

*  ♦ 

*  + 

*  ♦ 

*  ♦ 

+■ 
+ 


*  O 


* 

* 

# 

» 

* 

* 

* 

* 

*  w 

+  w 

*    • 

* .-« 

*<N 

* 

* 

* 

* 

• 

* 

00 

* 

Q 

* 

^ 

V 

<X 

* 

CO 

* 

■* 

< 

* 

2 

•» 

O 

* 

t-« 

* 

tf) 

■*-rj 

(N 

*     • 

*  -« 

X 

*  -« 

t- 

# 

M 

* 

< 

* 

* 

l/l 

* 

z 

* 

r_) 

*     + 


a 
a 


o 


o 

I 


I 


152 


*+**f»f*««»+*»*«»t(HI»t»f»  -a*********   V    v   *    *  +* 


■■»**■«*••*  »«+r«««»-r 


•  B 

♦ 
* 
« 
# 


* 

* 
o* 

• » 

» 


* 
* 


* 
* 
* 

.  » 


*  *  •f  « 


*  + 

*  + 

*  » 

■t- 

*  + 

#         ♦ 


+ 

+ 

+ 
+ 

#  ♦ 


*  c 

*  o 

*  • 

* 

* 

» 
* 

» 
* 
* 


*  ▼ 

#  + 


CI 


m 

■-n 


1 

1 

a 

t 

^-" 

— 

< 

1   si 

< 

» 

•  -^ 

« 

i/i,* 

» 

n  « 

» 

;?-* 

■» 

«i  ► 

* 

iC"-" 

♦ 

^ 

» 

< 

• 

■»  ^ 

« 

<j 

c 

~V5 

X 

i/l_l 

X 

< 

» 

rvj=) 

» 

(_> 

» 

r~ 

X  t-. 

* 

U 

>-i/i 

« 

• 

-*U 

» 

^  j 

"Srr 

» 

p* 

* 

i/lu. 

* 

.'O 

» 

U 

o 

■—(-0 

» 

r-  -i 

• 

*»l- 

♦ 

->_> 

» 

■U«J 

• 

>'-<X 

m 

>i 

» 

JJ 

• 

Oii 

# 

<~><t 

» 

r- 

• 

I>(/1 

« 

o 

«"3 

♦ 

i- 

;  - 

■* 

i 

_i  -J 

•-  ■» 

- 

o 

' 

'-> 

i 

• 

& 

15 


•* 
—« 

* 
* 


*  o 
x  +                                                                                                                                                      *o 

XL  »     . 

*  r-> 
X                                                                                                                                                                                                                                      *  ,Q 

•  X  n  ^ 

X  • 


in* 

•  * 

m* 
>** 

* 
* 
* 

* 
» 

» 
* 

* 


X 

•*      x 


♦        X 


#  +X 


X* 


*  in 

*  • 

»  >n 

*  <t 


* 

.» 

o» 

» 
* 
* 

* 
# 
* 

* 
* 
* 
* 

-Ti* 

<\l* 

•* 

IA* 
rH* 
-I* 


* 

•r 
« 

* 

« 
* 
• 

•  » 


*•-> 

*  m 

»  <H 

* 

* 

* 

* 

• 

* 

i/j 

* 

til 

* 

«— * 

* 

of 

* 

u 

-> 

i/> 

* 

* 

t'.* 

* 

X 

# 

rt 

*  lf> 

1— 

+  t\l 

*      • 

c 

«•  in 

l»J 

» 

CC..X 

i:  «■- 


x 
x 


X 

*  rH 

t— 

X 

•tt  — ' 

t/j 

ll.U'J 

* 

<r 

/    >t_> 

X 

-M 

u 

^  "» 

X            K 

u- 

•;D, 

X 

* 

.* 

OU 

* 

o 

*-«»-• 

X 

X* 

LL 

IL  u. 

X 

* 

a 

—  i.M 

» 

2J 

i   .LJv/l 

* 

*l 

«a 

*■ 

-{irq 

* 

-J 

H    !'    it 

* 

< 

ajeSI 

» 

<S 

:.'JT 

X 

*  o 

i-« 

_>->u. 

X 

+  0 

o 

a. 


"1 

•J- 


154 


O -n  o*  m -*  »f  f\i  ~o  o  *}-  — i  m  ^-"^nrnf^-r-oo 

«-ir\jaj,o''*'m  '"cM-j-t^r^to  -xm^oooj 

r-  >  «f  IA  f  fO  *«ji\ji\j»^.oo  r- <o  r- r<i  o  i  ,0 

u  f\jr^rr»*Mm  v^  %j"  tr  in  »*j  r»  ajHui^^u 

•    •••••  a    •    •    •    •    m  •••••• 

d»j-«y  .Qinr*.  rguiuis>«jaj  tPmf>>in«J'.0 

in<\i-*o>0(y  «>og»r  3>c»  •J-(\i-TO>Otf> 


niUlU'L^iHH  iMNI  re  wco^  v_y,-jrMr*.t-^w* 

<"<»rrir*jl/^'~r-  >-"-•  p- o  «r  m  ^.-jpv.pinm 

in^m^ivJU"1  u-sj- P|i<"IPJ'~"  vJ>sOin'\j/Ol/> 

>ompi_,ajo->  %r o><- fiu>--'  p-^-i-otpp-r- 

J>  p-  ~o  rf.  r-  —<  a>  j.  «io  porn  ^mu^r-rvo 

>OfMancj,t/>^j  P"mOr\jr\jin  -Urj>or-r-j> 

•  •••••  •   •••••  •••••• 

f\l  -O  •£>  _,  >0  <-p|  mp-noTO^r  ~Jinm(~;'jn— •      O 

>o<\i-o,^mp.  >Opg.o— 'in*-  -o  r\j  >o  „t  in  r-     r> 

■J'^O-rO'''1"  -r»o-*"^t-m  •j->ONrN0s*'ln     O 


«j-rou>p-r-c> 

*' ,(^J^-0•-,•-• 

_j 

-ro^<r>f^o 

mo\n)„$.ojr« 

<i 

#— i,— ir^sj-CvJrn 

,_,m<J,r--u'lo 

> 

ro,-tP-o-P"IOO 

(Nh.innj-ro 

0£ 

Jm-<a''"'j 

OCMin<D^- 

III 

•  ••«•• 

f- 

rgino>oao_i  mmajOeo-o  m-mnP--?f\i 

r»u\^g>m^  lp  up -r  pj  t  m  pjp-rp.|p-o 

oo»4jc^p- *r  Piajivjvmoj  in  lp  o  w  %o  nx 

^-Mjrsjco-org  -r^^rfMiNjivj  r'l-T^rnOrsi 

cMT>r-<srrjO  ••         uisj.n- .n."  ••          —<-rp-mcp^ 

■H'TiMiniru  1/7          ivjuikh— ,-ipj  i/»          >H(Mnnioi» 


C 
CP 


•"-•vT^OP-PJ  ITVLTnOT'XI}  IM.-u.u<(\JUirO        «/l 

Nfr'HOr-Cp- 
•   ••••• 

in  uj  uj  uj  o»  p-  >u  (j.  1/*  a-  o  i-r  «rf»--i)p«.r-«o 

O"  "-1  >r  rsl »-« 25  iP^^-rvjPJco  cp  ,-1  >f  nj  •""  CO 

roo-Tininm  m^^-mmm  roo-rm^in 


lo  CVn  P- C  >  rg     —  -o^OBMfl      —•  vt-fM^roCPO 

4-in>rjMnm     •-■         >rui^>i\lnui     •-»         ■j-m^j-uiL'Mn 


*c 

r>r»CP  PIP-iT"  «-» 

-©1—  <>*m.ra3  "-j 

conir-u'-TQ  u. 

cr  — iini-  o">cr  ^ 

mujnp-uuo  Ui 

•  »•••»  o 

p-r-  j3f\jOc\4  at 

p-i  >f  ~r  rnr- m  uu 


UJ 

0 

^ 

LU 

O 

Q 

rq 

»— « 

Li. 

•  • 

■£. 

UJ 

O 

2. 

O 

** 

(- 

or 

'J 

0 

LL 

< 

ntr^t  —  co«4jm 

UJ 

"tii-oJu-H^^rg 

L_> 

C  M'lOUUI 

.— . 

CU'-^nii/H 

u_ 

l>  .l^jt  -*(j"x  V,  ,_| 

?■ 

U'i*v  rn^uu 

C3 

•    *•••« 

'J 

ujv«_»<_***»*o 

o->  mj  0  pj  c  tN) 

UL 

n )  «»■  >T  in  p.  "  > 

UJ 

UJ 

jT 

_i 

►  -« 

r\j  rr  uj  i  xj  sf  i/* 

0 

l/"— « t_>ro  ^-m 

OJ 

•-4 

>]  r- .J- i-P  r»  j» 

l_> 

IT 

j»inu  >h^  (■*•»>* 

^1 

LJ 

r^c  'uui_ipt^> 

<I 

M    »4Jf^l>T  vTU\ 

0 

f— 

•    •    •    •    •    t 

►-* 

l^) 

r*-  uu  cMJ*  *J"  in 

u- 

<a 

tP-Ou>«— *C  fM 

►H 

0 

m^Nj/u  »r*ai 

< 

u 

■D 

0 

•— 

u 

1/1        u. 


155 


•  ft 

sOft 

-<♦ 
ft 
ft 

* 
* 

ft 
•f 


•  X 
X 


♦  ft 

*  c 
+c 
»    • 

*  — 
«  -o 

ft  >H 

ft 

* 

ft 

« 

ft 


* 
* 

•  • 

4-ft 

-■ft 

♦ 

* 
* 
* 
* 
♦ 
ft 
ft 
ft 

t 

ft 
* 
* 

•»+ 
•* 

o* 
"i* 
-i» 

ft 
ft 
ft 
ft 
ft 
♦ 
* 
ft 
ft 
* 
* 
ft 
ft 
ft 
in* 

l\l«- 
•* 

in* 

r-l* 

« 

ft 


* 
ft 
ft 
ft 

« 

•  » 


ft 
* 
* 
ft 

ft 
ft 
ft 

ft  in 

■ff- 

♦  • 

*•* 

*  H 


ft  *x 


x# 

ft  ♦ 


X 
X 


* 

* 

ft 

ft 

ft 

* 

* 

• 

*o 

+  w 

*    • 

*  o 

ft  r*1 

♦  ^ 

ft 

* 

ft 

ft 

• 

« 

l/l 

♦ 

UJ 

* 

*-* 

• 

a. 

♦ 

UJ 

* 

i^-» 

# 

-»_l 

* 

Ui 

<< 

» 

£ 

>> 

ft 

NH 

uror 

ft  LA 

1- 

U  U.I 

♦  IVJ 

n-(- 

i       • 

CS 

Z*. 

ft  LT» 

U-' 

*-*•-• 

ft  »H 

(- 

*    »-* 

1/1 

ulu- 

>» 

< 

UL-' 

ft 

O 

2Z 

It 

Ui 

i.;i 

ft 

CC 

CjU 

ft 

o 

*-*•-• 

* 

Ik 

u.  u. 

X* 

£-£.\f\ 

ft 

t_) 

'J'.jS 

ft 

<e 

OCil/l 

IT 

^. 

< 

* 

■«:<*.  a 

» 

_l 

L.  ' '.:i- 

*• 

«* 

a  -*a: 

W 

«£ 

O.UU 

«o 

•-« 

J-JU. 

♦  o 

o 

3 


in 
o 


o 
o 

• 
in 
o 
m 


156 


0»  o  f- O  r- *»■  ir\ir.r-uJiri,o  O'TiriB^O' 

r*-(\jOiD^-*f\j  ^r-  >omp-p-  r  j^om^rsj 

en^N',M'i  rif~i-P,-HC\it-<  t-i^-tMp-  ltpvj 

<->o«t <nios,>J  **  o*-t—  r-c  r- (*•,"■< -o>-t •*■ 

irvff  rgrrn/^rr)  ■J'-'trpnom  a  r~-u  .oj,— m>i 

■*J  CO  ^ '  ^  0s  *J  '""O^  ujcmcp  u  «r*-"— »*jr»  -im 

•   •••••  ••••••  •••••« 

Op-i^in^t*  —•tnul*J"<Jr-  u>rj(>i>fmui 

inpg-Tt^Otf*  ITllM'TU'OO"  >T  CM  ^T  CP  O  0s 


n^i"wrti»  oi^jvr  >\jp-p»  tc-ouj<_("—<>4 

(*  j  ao  *i  -r  m  r\j  u»-ocicj~,in  ojj*rin>ru» 

p-.0tt/nt>j-(\j  r->rrirn*-<'-«tn  cup-.-arom^o 

tn^gtrr^popg  (\JOP-Oino  oD^iMi-no^ 

*OtrMn<T?.— iro  <r\  •*-  »-h  r-  *$■  eg  p-roo»"or*-*J" 

m'"~")fnir>ir\  •j-coinmp-au  rg.org-j,Pvi<M 

•  •••••  •  •  •  ,  •  •  •••••• 

f\jm0r-4^0(\l  o"l  -c—  «■  J|—  r^  ■-i*jvJP.r^Ln— <      3 

•org-o-^mr-  ^o lNJ -o -^in  f^  opj-o—imP-     o 

• 

o 
o^ 

>or-oo^j-<t>m  r-aofiOvoa*  o<^u'mrM*o    to 

inouirgwr-  LTi<Ur<rriM  ^-"q»-'ij>pi-o      -J 

r-r~<Mm^o  ujr-tPincMin  ^  ^-oicor^— <     ^ 

■tf-  it  o>  r-  >£>  ro  m.-i*or»<\i<\i  ki^h^oio     > 

<MC7*p'>m<Jp-  Ont.fj^  -J- cr.^ -C -^  <^      CL 

—•^op-cm^o  tvicooc  -jr-p"!  omlncrr"--    uj 

•  »»•••  •«••••  ••••••!_ 

miT^X  ujr*  ^aoujtpu^uo  ^r^^H;r^l''u^      2 

C7* »— t -J*  (v  •"*  T3  Or- i^TPsl^fl?  r*  — «  ^  r\j  *-•  <3j      •-• 

n>u>rinu>ir\  «>>.o^rmintri  m^v^uiin 

u> 

o 

Q  rO 

PJ^OCM-OtD  cur-— •^•J-f—  — i^tnj-vPlin       —• 

— <J3P-JJlMm  -t)sOP-'  —  .OlT>  t-l(M<Mvr  -T-H       tL.                   •• 

u\«— »»— i^hnT^  i-J  "l  ^T » ""  O  *$-  r- '  —  nU  in  tP  VJ        ^-                   IU 

■T  tn  C7>  O  O  U»  in  _i  (NJ  uj  xT\  CO  p  |  uu  in  PI  -O  O       l_)                  2. 

i — j-"-  icv-p      ••  -ri-T\Pl<rin.o  ••          Om  JJuj^hpi      i_j              •— 

tj  cr1  T?  o  P 1  p  \      co  w*-«tj>i>j  jta^  to           cu  cp  p»  «j  — *  t-4                        *— 

<•...•!_  ,    •    •    ,   ,    •  f-             ......,, 

•Tp-i-rP-o-H     —<  u  > -r  >±)  co  — i  cm  •"-•         rr\_«.-<yr>CMJ     ra             3 

r-«  ^- r>  o  C7>  o     i  rH^ru-jjvrj  a.         ^>roo-oo     u.             < 

>T  in -j- tr\  in  " '     «-•  -r»i-rmu\m  •—         ^-uisj-u^min             h    uj 

—1  — <  _i     fn     _j 

jj     — • 

••                                      UJ  jj  >      ..     t— 

to                                     <j  o  uj     £.     to 

iu                                   ■*:  ,.  ^:  -1     —•     <i 

_j         uu cr r» o > n u"»     fc*'  >j  -o t-J *r rsj *a  u»         u^p-u'ojr^o             cj     ^-* 

_J             »'Ulir\'jr--T       I— I  JU  X)  I"  I  ^0 'TJ^  l_l             "j  sj- n-i  j^  r>- ^3       UJ        >-•       UJ 

«i         -urnmr-<v<m     •-<  it  •$  r~  cm  >r  c  '-,         ucj'-,>x(^ur~     *->     cc     u. 

-»          u1uj^uiu"m      u.  uj1)ujc,*ph  u-           u  tu  1  \i  cj  r\j  p  1      ^1      LJ      LJ 

■*  -t  1  -  cr t_i ■-*     ^  t.^vj-,-''r-"-'i"*  ii         if  j-riMU'ir     «i             u. 

r—           ^J<MtJtJlJ,  •— »      <-)  r-^j- '^PsJ'-^pi  C_)           u  »ogu-  lp  ^oj      tj      ►— 

ui             »•••••     O  ••••..  i_>             •.••'••-•lOjZ 

«a          i«w,uo»''^J  C7*  o  •"•«--•  ^  p*  r*ujtuco  pi  vj-      u-      *i      13 

U            CP  ^J  ^  Pvl  C*  CM       or  U-NiUNOI'J  C£             O-J'U'— 'OPJ       •-•OS' 

uj         pinJ-^j-  inP-m     uj  m^-ri/\r-in  uu         "ij-sj  u^r-in     ^      t'j     ■-• 

a:                                        a.  *  ij      cr      X 

o                                a.  o  —><—•«». 

u.                                  _J  -<  to     u.     x 


157 


o+  *  o 

<?>♦                                                                                                               X  fO 

•  *                                                                                                     X  «■     • 

O*                                                                                                                         X  *  o 

>t>»                                                                                                                                                                             X  *  \Q 

-<#                                                                                                                                               X  #-< 

*  X  ft 

*  »x  * 
e  »x  # 
»  xx  » 

*  x  +  * 

*  X  *■ 

*  X  li- 
ft                                                                                                                      X  * 

*  X  * 
»  X  * 
ft                                                                                                                                                                 X                        *  » 

*  X  *  * 
«                                                                                                                   X                                •*  * 

*  «.                *  * 

»«*     x                       *  *  m 

'-♦                                    #  +r~ 

•#                                                x                     «  ♦  *    • 

*W*                                                                                                                          X          •                                   *  »   -U 

fi»                                                                                         x                            •*  *m 

-•*                                                                                                                                 x             x  *                                                                                   *  .-I 

*  X  *  * 
«                                                                                                                                                                                       X                            *  f 

*  x  •«•                                                        •» 

*  x  *  ■*■ 
ft                                                                                                                            X                *  » 

+                             x                      *  ♦  ♦ 

*  x                  *  * 

ft                                                                                                                           X             #  * 

*  x                  «  # 

*  X              •*  ft 

*  X             ft  ft 

*  x*  ♦  * 

*  X         «  ♦ 

*  x  ♦ 

O*  X                                                                         *   -J 

ip  +                                                                                                                      xx  *m 

•ft                                                                                 X  ft     • 

f»#                                                                                           X  »r» 

r-l»                                                                                                                                                                                                                                         X  *     -I 

•-1*  X                                                                                                              £  —I 

*  X  » 

*  X  » 

*  X  * 

*  X  *                        • 
»  X                                                                         ft                    v» 

+  x                                       +               u' 

»  X                                                                  «                ►-. 

»                                                                                                                    x  y                cf 

*  x  *            ~<u. 

*  .                            .                    X  ft                  «/> 

*  X  *                                        -J-J 

*  XX  *                     u                 <:< 
ft  X                                                                                          *                  H  2"                >> 

*  X  ft                •»•            a:of 
ui*  x                                               a  u>        (.,(_            u  u 

•*  x                   <"    •        ^t-»            ^2 

0»  X                                                                         •*    MJ              <tu                     •—»>—•       (/) 

IT*  X                                                                                                 ■»  <7>            DTI—                               t- 

*  X  *                     oO               ''J"J      '£ 

*  X  *                   li-«                  DO      ►"■ 

*  X  »                   l_l>-»                  *iJi      O 

*  x  *               uj            iji-    a 

ft  X                                                                         *                    l-at                    CJCJ 

»  X                                                            *                3CT               — '-'      < 

▼  x                         *             i_»"-             "-u.     i— 

*  x  *                                                  ^-^^1 

«  XX*                OU               UJrjj-u 

*  x  »               i— 2T              uow 

*  •«■  »             *s«*                   <-J 

ft                                                                                                                                               .x  .      »               _                   c'lO'' 

*  x  ♦           n_i           "'  -"J 

*  x  «             a«s            a.<u:'- 

^  x                         ft                     ^                li.i_j.JU 

c*  x                       *o          u-—>               .J_)^-«* 

C  ♦  x                        «.r>          UO 

•  »  »    •              — 

t-  r-         u.  w               •  +  *  * 

m                                    <M                                    rj                                    —>  -h                                   o                                   <w>i 

>->                                 io                                 m-                                 !••  (M                                 ■—                                 >-<               _v 

•                                   •                                   •                                   •  •                                   •                                   •               £. 

W>                                                       r^                                                       <•!                                                       PI  r-i                                                      W                                                       l~ 

o                                  >»•                                  to                                  ca  *j                                  u>                                  ro 

vj                                  u>                                  x                                   >r  <*>                                 rg                                  f\j 


158 


n  "M —>  ^-  i*-  iri  vj-  4-  •Jt-.t  jt-  J*fO<v  r  o^  J5»-<fM^-r^cj 

rji— <\4f\j>w-ro<m  >'*-JOU">f,>f"-uoo  M-r>)-'-'3>'-'rHiJ 

•   ••••«*•  •••••••■  •••••••• 

oou>»-«iA*-«fri»-"co  *ucc~,u"»^*rr>Li*co  cur^-^m^rocMO 

mci^j-iri'Tirifn.}-  rriro-J"m'J-mm>r  rnro^irv^iriro-J" 


(\irour>rnmMja&ui  -J"  co  *J"  u  %  u>  kj  *u  ao  vl»*j-cni — .rii'-or* 

r-O^OUjrnHjsULi*  ui(vjuuji'ir*^fri  ^onu^wm^jcg 

rim-  rrirjcuviMj  rgpM- <   ~«f^j»-  o  -n  t>  in  ^f  -\j  <a  o 

r~— <rvou  j-oo1^  *»  ^ u» o ^" f\j r~- ^)  couj"X<uujfjjr\jiu 

•  •■•••••        ••••••••  •••••«•• 

inro— i-j-f-mo-o  -o_-\f\iin— i^—wj  »r<N'-!<\icD^rcMn  o 

r~^^lo^f>"»l'>lf^a,  i~-  ro  -u  u"»  o  mm  u-  r-m^iu>^>u>^-ij>  ^» 

rn  ~j- m  ir«  ^j- -r  j- ~r  ^n^-niu-i^t-r^^j-  «>«rrrnr\ci>r«r»»"  o 

• 

o 

a)0'<-'OC  -TJ11^  (r^vucocoaDCr-i  nic^^-r-ooui jvuj  i/i 

"•(Mw-om^^-1^  ivrow"  comtrou*  i-jr^t—cc-^'^ -^u  — ' 

LPrgCTsjf^  — "roc  f  cocj  ^mu>0"^  i*-  m  -o  r-  c-  — '  -o  u  >  ^ 

r-CJ^u^i-ic-if^ccrg  <~o,u1o^"<N'"-'oo  in  oori —*<*-,"  i  ,j-m  > 

w sj- co r-  as r\i ci oo  Ci/\CpOiflh-N  c0(<-ir~unin  J>(^m  u.- 

•  •••••••                   •  •••••••  •   •••»•••  i— 

mvj-uj»j-cj"",ico  <^- in  o  o  <M -J"  nT  <_>  >rrOf—  nu'«c- ir»  *. 

s; i-j r^ X) >r i-i (\j  a->.-<co:^«<J-r>-i'r>  co.-<r-ir  ir\«j-t-t'M  «-» 

mm''<«j-rn-*"iA>j'  *iin"i  .j-m-yin^  «T>inm>rfi«j,in',r 


<)<■  -r °J  — < <) .0 f\i  c0'""ir~-<DOinr— oj  o  ~) -0*J"'_"Mt-,rr>  •-• 

>u " ' -o ^ r- "-"M 30  aofN/ixjcoNr'^i-^-r  S  j.  in  mj  in  o .— i^—  u-  •• 

uir-i— r-> -j  i  si  t<\  ~. i  x-r-ifirvir^-r-ip-p)  <\.  (^  <\i  ■-"  ^  -J-  <->  U*  (_>  i. 

«rcrcj<r  -rur-TO  ••  .-(.-ltn<rco•-"^il-',  ••  N-n^-r^r^jo  o  _ 

n-^NO-Hr-iu\'^^.  a.  m-i^riHinoiri  i.  me  o— '  — <mO>j-  u_  <s 

_i  — i  —i  rg     _i 

ii'  •-> 

..  lu  a;  >  ••     t- 

to  o  l_)  U'  ^i      «/> 

iu  v*;  ^:  -<  "     < 

— )            O  00  C7^  t>  --<  ^*  4"  *T  i-J  w^j'TMiii^^  lj  j^iANTaJTUMMr)  (_.'  ~~        1J 

*»         >Tfri?c033'nff'  *-■  HO-riMOiMnr-  ►-<  mj>r-uH,\,i'n/'  o  u-     t 

^           >3-  ~q\  Mr»iu  isj-u^  *u  **-  uiui"^  j"-<ojO  "-  r^^'v-'U  jjimivj  ^-  v_*      LJ 


0«  ^Oivir-"— 'M-n-O  c1^1'  iujr\j^-Tr- 

tr\ <f  m -T  -r  ro  —  ^-      lu  '•>  T''  i  ^  ^r  cn-O-f 


»_i  U' V^«*  ^t       [J)11""* 

-i 

u_ 

l~LI-'_»'XVI—  — -V 

J 

V- 

^^ 

to 

J- 

VA^  sj"  •— »  ^J  w     flV-J 

ii. 

-- 

_J 

g-uii'n.'*)u'i.'l'i 

*-- 

LJ 

> 

"i  vrr-i  j-  >r ">'*/•<' 

.' 

^ 

«-" 

•-•         LJ         ** 


159 


APPENDIX  C 

LISTING  OF  DATA  SETS  RESIDING 
IN  THE  TIME  SERIES  EDITOR 


This  appendix  contains  listings  of  the  data  sets  now 
residing  in  the  Time  Series  Editor.   The  data  consists  of 
Box  and  Jenkins'  [Ref.  4]  time  series  C  [Ref.  4,  p.  528] 
and  time  series  G  [Ref.  4,  p.  531],  as  well  as  a  data  set 
containing  monthly  Monterey,  California,  rainfall  data 
from  January  1931  through  December  1976  . 
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